-- Logs begin at Fri 2022-01-28 07:12:22 UTC, end at Fri 2022-01-28 08:40:16 UTC. -- Jan 28 07:57:19.105848 dv-cinder-804035-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 07:57:19.113134 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 07:57:19 2022] *** Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: nodename: dv-cinder-804035-28-iscsi Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: machine: x86_64 Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: clock source: unix Jan 28 07:57:19.115102 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: pcre jit disabled Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: detected number of CPU cores: 4 Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: current working directory: / Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: detected binary path: /usr/bin/uwsgi-core Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: your processes number limit is 47680 Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: your memory page size is 4096 bytes Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: detected max file descriptor number: 2048 Jan 28 07:57:19.115615 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: lock engine: pthread robust mutexes Jan 28 07:57:19.116933 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: thunder lock: enabled Jan 28 07:57:19.116933 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 07:57:19.116933 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 07:57:19.161388 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: Python main interpreter initialized at 0x557e5c3e49c0 Jan 28 07:57:19.161388 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: python threads support enabled Jan 28 07:57:19.161388 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: your server socket listen backlog is limited to 100 connections Jan 28 07:57:19.161388 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: your mercy for graceful operations on workers is 90 seconds Jan 28 07:57:19.161744 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 07:57:19.161845 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: *** Operational MODE: preforking *** Jan 28 07:57:19.162072 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: *** uWSGI is running in multiple interpreter mode *** Jan 28 07:57:19.162072 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: spawned uWSGI master process (pid: 102470) Jan 28 07:57:19.162266 dv-cinder-804035-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 07:57:19.163396 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: spawned uWSGI worker 1 (pid: 102471, cores: 1) Jan 28 07:57:19.163396 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: spawned uWSGI worker 2 (pid: 102472, cores: 1) Jan 28 07:57:19.163396 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 07:57:20.948432 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 07:57:20.948432 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: from cryptography.utils import int_from_bytes Jan 28 07:57:20.949191 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 07:57:20.949191 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: from cryptography.utils import int_from_bytes Jan 28 07:57:20.959863 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 07:57:20.959863 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: from cryptography.utils import int_from_bytes Jan 28 07:57:20.960350 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 07:57:20.960350 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: from cryptography.utils import int_from_bytes Jan 28 07:57:23.527701 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 07:57:23.528381 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 07:57:23.528481 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 07:57:23.528825 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 07:57:23.528899 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 07:57:23.528973 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 07:57:23.529048 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 07:57:23.529120 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 07:57:23.529311 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 07:57:23.529420 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.529526 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 07:57:23.529703 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.529898 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530025 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530230 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530344 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530559 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530671 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530883 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.530981 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.531218 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.531360 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.531558 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.531646 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.531891 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532021 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532170 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532314 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532479 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532578 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532786 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.532880 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-28-iscsi {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533105 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533197 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533410 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533503 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-28-iscsi {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533718 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.533810 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534035 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534131 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534334 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534429 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534652 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534746 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.534956 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.535050 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.535302 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.535476 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.535623 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.535914 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.536145 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.536253 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.536460 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.536556 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.537298 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.537386 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.537617 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.537704 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.537951 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538036 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538270 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538431 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538609 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538710 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.538898 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539004 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539205 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539434 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539554 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539646 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-28-iscsi {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539874 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.539976 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.540236 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.540344 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-28-iscsi {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.540547 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.540691 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.540886 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541014 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541206 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541332 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541541 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541686 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.541861 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542018 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542185 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542285 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542491 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542593 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542858 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.542960 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543175 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543299 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543535 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543632 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543852 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.543949 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544157 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544244 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544466 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544570 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544772 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.544871 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545088 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545181 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545411 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545503 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545693 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545780 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.545943 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546034 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546250 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546345 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546547 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546641 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546863 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.546956 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547179 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547306 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547457 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547546 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547706 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.547861 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548022 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548117 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548343 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548444 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548648 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548738 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.548956 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549052 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549261 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549358 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549572 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549661 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549875 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.549972 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550180 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550317 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550482 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550610 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550787 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.550923 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551103 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551236 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551439 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551569 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551759 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.551887 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.552064 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.552199 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.552939 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553178 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553312 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553446 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553588 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553721 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.553853 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554005 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554198 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554333 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554515 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554651 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554823 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.554922 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555138 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555224 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555485 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555572 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555794 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.555891 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556097 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556189 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556403 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556495 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556722 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.556810 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557034 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557118 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557343 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557427 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557593 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557687 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557894 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.557979 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558198 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558283 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558516 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558624 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558823 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.558909 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559127 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559211 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559461 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559556 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559760 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.559861 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560064 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560151 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560367 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560459 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560670 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560753 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.560974 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561069 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561277 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561369 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561579 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561665 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561883 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.561979 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562184 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562277 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562486 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562582 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562795 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.562887 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563105 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563193 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563432 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563520 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563735 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.563830 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564039 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564125 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564342 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564442 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564658 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564757 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.564961 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565046 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565263 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565350 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565580 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565675 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565879 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.565963 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566183 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566270 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566498 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566595 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566802 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.566907 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.567105 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.567193 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.567447 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.567546 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.567743 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.568079 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.568400 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.568485 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.568714 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.568839 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569028 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569114 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569334 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569427 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569642 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569729 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.569945 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570029 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570245 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570331 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570548 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570635 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570850 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.570938 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571152 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571238 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571475 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571563 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571791 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.571883 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572093 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572187 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572404 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572538 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572707 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.572821 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573012 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573106 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573329 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573415 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573638 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.573722 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.573969 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 07:57:23.574069 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.574307 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.574391 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.574620 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.574706 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.574950 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575047 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575300 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575401 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575620 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575710 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.575933 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576020 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576248 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576334 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576572 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576666 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576883 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.576992 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577193 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577285 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577504 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577590 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577818 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.577903 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578133 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578217 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578455 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578552 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578767 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.578872 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579081 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579168 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579429 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579526 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579740 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.579827 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580056 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580142 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580370 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580454 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580690 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580775 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.580999 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581085 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581333 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581425 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581651 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581738 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.581972 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582074 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582298 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582393 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582610 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582696 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.582932 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583018 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583285 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583391 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583603 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583699 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.583921 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584008 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584245 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584338 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584560 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584651 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584875 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.584961 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585204 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585289 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585517 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585601 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585830 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.585915 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586135 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586222 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586439 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586526 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586742 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.586828 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587052 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587140 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587380 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587481 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587699 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.587786 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588009 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588094 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588317 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588407 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588648 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588747 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.588954 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589043 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589265 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589359 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589579 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589673 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589886 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.589972 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590189 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590275 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590499 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590596 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590806 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.590899 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591108 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591194 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591452 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591552 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591763 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.591849 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592067 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592155 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592388 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592485 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592692 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592786 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.592996 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593089 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593308 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593401 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593617 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593703 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.593926 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594013 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594236 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594324 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594553 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594637 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594860 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.594952 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595169 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595278 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595523 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595619 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595844 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.595943 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596144 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596228 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596467 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596566 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596792 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.596887 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597107 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597194 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597411 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597504 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597720 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.597815 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598024 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598120 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598326 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598488 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598628 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598728 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.598936 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.599021 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.599768 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.599856 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600079 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600167 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600382 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600470 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600686 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600772 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.600989 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601076 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601296 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601381 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601603 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601687 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.601928 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602015 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602245 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602331 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602557 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602651 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602868 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.602957 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603179 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603326 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603549 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603713 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603862 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.603948 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604189 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604274 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604511 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604607 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604825 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.604911 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605141 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605227 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605449 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605545 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605759 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.605845 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606069 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606155 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606380 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606478 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606696 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.606780 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607004 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607090 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607347 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607438 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607657 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607745 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.607979 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608064 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608288 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608376 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608607 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608694 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.608911 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609000 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609227 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609322 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609535 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609627 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609857 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.609944 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610188 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610274 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610508 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610601 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610817 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.610903 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611131 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611225 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611465 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611552 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611775 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.611871 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612084 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612177 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612392 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612478 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612710 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.612802 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613016 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613100 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613334 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613428 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613640 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613734 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.613959 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614048 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614268 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614362 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614584 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614683 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.614941 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615029 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615263 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615352 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615594 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615680 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.615916 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616003 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616222 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616307 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616534 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616622 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616852 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.616938 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617159 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617246 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617465 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617560 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617773 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.617866 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618076 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618162 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618377 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618466 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618685 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618778 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.618997 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619092 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619328 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619418 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619639 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619732 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.619946 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620045 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620259 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620352 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620562 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620654 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620864 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.620962 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621164 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621251 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621474 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621607 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621783 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.621884 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622088 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622182 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622407 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622500 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622720 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.622807 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623021 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623113 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623349 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623450 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623674 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623806 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.623981 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624068 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624285 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624375 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624589 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624678 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624891 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.624977 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625211 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625296 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625524 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625611 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625828 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.625913 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626143 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626229 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626463 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626551 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626773 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.626859 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627085 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627180 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627421 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627510 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627732 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.627818 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628053 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628157 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628366 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628452 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628675 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628773 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.628987 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629083 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629298 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629385 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629611 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629697 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.629928 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.630029 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.630247 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.630830 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631081 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631166 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631416 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631506 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631728 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.631816 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632033 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632119 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632343 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632431 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632654 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632745 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.632973 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.633211 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.633338 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.633543 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.633848 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.633935 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634165 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634250 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634485 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634573 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634802 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.634888 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635131 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635225 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635484 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635573 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635796 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.635883 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636100 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636199 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636409 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636504 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636713 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.636800 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637015 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637111 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637325 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637412 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637631 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637717 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.637935 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638024 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638238 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638324 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638547 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638641 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638849 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.638939 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639163 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639303 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639497 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639586 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639800 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.639899 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640114 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640201 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640423 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640519 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640735 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.640822 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641038 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641135 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641356 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641441 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641661 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641746 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.641966 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642053 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642268 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642355 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642569 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642656 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642883 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.642976 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643195 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643300 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643555 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643643 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643866 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.643996 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644211 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644298 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644512 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644611 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644815 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.644903 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645140 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645227 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645445 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645558 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645748 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.645835 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646101 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646194 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646414 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646509 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646721 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.646815 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647023 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647109 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647361 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647467 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647675 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647750 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.647984 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648071 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648292 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648380 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648594 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648672 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648901 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.648985 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649203 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649282 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649518 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649605 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649822 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.649897 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650124 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650202 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650431 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650516 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650737 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.650819 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651041 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651117 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651365 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651445 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651677 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651778 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.651982 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652068 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652314 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652405 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652655 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652749 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.652977 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.653061 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.653288 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.653562 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.653650 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.653891 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.654098 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.654209 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.654525 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.654652 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.654839 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.655198 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.655301 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.655584 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.655840 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.655929 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.656195 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.656433 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.656520 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.656807 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.657018 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.657105 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.657421 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.657582 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.657750 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.658071 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.658163 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.658382 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.658702 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.658788 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.659014 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.659332 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.659427 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.659657 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.659915 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.660004 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.660263 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.660539 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.660629 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.660869 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.661129 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.661217 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.661475 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.662242 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.662333 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.662633 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.662839 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.662926 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.663254 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.663454 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.663561 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.663875 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.663976 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.664208 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.664339 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.664739 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.664828 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665062 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665150 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665392 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665478 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665709 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.665805 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666027 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666126 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666341 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666428 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666658 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666752 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.666970 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667078 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667303 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667392 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667617 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667717 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.667929 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668017 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668238 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668330 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668550 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668646 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668879 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.668973 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669198 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669292 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669516 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669612 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669837 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.669925 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670153 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670240 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670468 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670557 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670777 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.670862 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671083 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671168 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671422 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671509 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671736 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.671822 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672052 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672137 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672356 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672454 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672663 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672755 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.672979 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673065 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673306 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673390 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673590 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673679 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.673906 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674000 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674218 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674353 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674534 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674621 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674835 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.674930 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675146 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675239 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675484 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675570 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675796 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.675899 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676105 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676190 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676412 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676512 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676724 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.676817 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.677033 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.677120 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.677917 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678015 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678233 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678353 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678547 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678676 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678857 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.678996 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679168 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679333 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679505 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679652 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679811 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.679972 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680134 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680295 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680446 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680615 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680758 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.680928 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681090 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681353 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681484 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681664 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681750 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.681969 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682066 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682283 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682396 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682594 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682713 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.682903 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683027 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683221 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683357 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683575 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683665 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683888 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.683981 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684201 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684288 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684513 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684614 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684841 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.684935 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685151 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685260 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685485 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685579 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685871 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.685964 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686185 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686280 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686491 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686585 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686795 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.686912 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687106 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687229 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687457 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687559 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687763 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.687887 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688067 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688215 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688374 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688551 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688698 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.688842 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689007 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689163 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689332 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689479 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689745 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.689845 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690059 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690148 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690364 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690452 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690732 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.690820 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691043 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691134 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691399 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691490 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691725 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.691813 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.692043 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.692128 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.692382 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.692470 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.692671 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693022 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693276 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693373 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693592 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693688 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.693917 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694005 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694242 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694337 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694553 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694647 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694868 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.694986 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695171 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695274 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695533 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695633 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695846 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.695943 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696174 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696263 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696486 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696586 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696803 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.696912 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697117 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697236 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697429 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697548 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697738 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.697868 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698044 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698196 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698371 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698500 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698682 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.698804 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699009 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699116 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699352 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699443 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699680 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.699767 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700006 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700101 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700316 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700412 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700637 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700723 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.700950 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701035 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701255 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701341 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701556 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701650 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701859 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.701954 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.702182 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.702268 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.702488 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.702575 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.702809 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703087 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703215 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703361 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703488 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703571 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703798 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.703899 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704137 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704227 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704457 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704550 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704767 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.704896 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705072 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705160 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705378 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705478 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705683 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705771 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.705999 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706085 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706316 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706402 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706624 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706715 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.706934 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707021 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707289 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707381 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707581 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707669 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707891 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.707992 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708202 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708296 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708537 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708628 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708861 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.708947 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709168 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709263 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709482 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709568 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709788 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.709883 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710096 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710190 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710400 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710477 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710707 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.710783 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711012 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711104 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711343 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711424 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711651 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711729 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.711958 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712043 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712279 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712380 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712583 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712662 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712889 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.712967 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.713214 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.713297 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.713525 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.713621 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.713830 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714092 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714210 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714288 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714553 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714640 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.714876 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.715200 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.715319 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.715551 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.715803 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.715890 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.716250 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.716421 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.716580 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.716904 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.716991 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.717446 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.717608 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.717782 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.718104 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.718223 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.718425 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.718746 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.718836 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.719067 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.719412 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.719514 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.719734 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720039 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720128 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720354 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720641 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720730 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.720992 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.721249 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.721345 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.721639 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.721845 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.721980 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.722304 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.722457 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.722627 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.722949 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.723036 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.723288 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.723645 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.723735 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.723965 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.724635 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.724816 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725157 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725248 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725569 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725658 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725904 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.725997 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.726244 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.726444 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.726568 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.726783 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.726878 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727109 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727206 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727476 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727564 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727801 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.727889 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728125 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728215 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728447 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728554 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728768 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.728867 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729085 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729185 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729401 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729489 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729717 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.729805 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730036 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730123 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730362 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730450 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730691 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.730889 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731031 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731214 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731384 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731578 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731705 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.731912 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732025 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732246 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732333 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732570 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732693 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.732896 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733014 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733231 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733318 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733544 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733640 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733857 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.733946 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734176 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734262 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734494 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734590 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734809 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.734907 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735136 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735223 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735478 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735586 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735791 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.735880 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736104 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736199 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736418 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736508 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736732 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.736954 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737042 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737306 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737405 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737631 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737719 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.737961 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738048 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738288 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738383 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738607 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738695 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.738921 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.739121 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.739281 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.739468 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.739584 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.740366 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.740474 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.740699 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.740841 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741027 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741116 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741354 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741441 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741662 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741756 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.741978 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742067 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742286 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742383 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742593 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742729 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742905 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.742993 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743216 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743368 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743547 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743649 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743870 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.743958 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744185 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744272 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744491 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744591 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744879 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.744986 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745123 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745212 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745434 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745650 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745739 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.745998 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746085 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746319 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746415 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746647 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746743 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.746961 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747049 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747295 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747417 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747607 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747700 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.747915 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748001 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748225 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748312 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748531 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748627 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748845 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.748953 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749158 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749257 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749459 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749560 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749761 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.749850 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750072 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750161 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750381 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750476 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750688 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750778 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.750999 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751088 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751333 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751434 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751661 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751764 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.751968 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752254 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752342 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752563 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752649 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752878 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.752968 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753185 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753273 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753491 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753579 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753798 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.753888 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754101 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754195 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754414 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754501 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754716 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.754812 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755028 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755127 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755398 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755504 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755715 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.755804 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756022 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756120 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756334 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756430 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756640 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756728 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.756966 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757056 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757275 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757371 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757581 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757669 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757897 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.757983 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758208 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758295 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758528 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758623 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758838 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.758925 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759165 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759314 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759525 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759613 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759842 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.759941 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.760164 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.760418 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.760506 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.760756 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.760851 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761082 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761179 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761395 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761482 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761718 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.761807 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762036 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762133 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762345 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762434 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762653 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762741 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.762977 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763069 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763311 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763405 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763627 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763714 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.763937 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764033 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764248 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764336 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764559 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764655 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764869 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.764979 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765181 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765288 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765489 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765614 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765799 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.765939 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766109 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766278 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766419 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766624 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766718 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.766961 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767069 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767323 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767430 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767642 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767739 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.767955 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768043 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768268 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768364 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768588 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768677 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768902 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.768995 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769210 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769311 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769521 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769609 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769836 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.769924 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770168 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770265 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770481 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770576 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770788 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.770876 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771152 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771271 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771510 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771598 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771837 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.771924 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772156 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772245 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772476 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772562 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772799 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.772886 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773118 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773208 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773428 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773514 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773744 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.773840 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774053 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774143 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774368 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774455 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774702 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.774798 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775029 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775124 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775376 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775475 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775682 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775820 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.775991 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776078 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776297 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776386 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776611 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776700 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.776945 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777043 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777280 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777367 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777593 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777681 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.777915 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778001 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778225 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778312 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778541 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778629 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778850 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.778944 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779171 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779334 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779522 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779610 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779839 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.779934 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780151 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780247 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780483 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780572 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780796 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.780884 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781117 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781225 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781431 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781519 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781743 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.781831 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782054 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782150 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782364 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782452 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782689 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782784 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.782941 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 07:57:23.783037 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.783328 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.783656 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.783973 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.784294 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.784610 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.784922 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.785252 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.785563 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.785880 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.786192 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.786505 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.787366 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.787687 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.788015 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.788341 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.788668 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.788996 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.789342 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.789656 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.790001 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.790330 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.790647 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.790963 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.791292 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 07:57:23.791545 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 07:57:23.807368 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_db.sqlalchemy.engines [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:23.814444 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:23.869943 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.context [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38a2885c-64c6-4bdb-8906-386a5b1cde09(cell1) {{(pid=102471) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 07:57:23.874075 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_concurrency.lockutils [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 07:57:23.875614 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.context [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38a2885c-64c6-4bdb-8906-386a5b1cde09(cell1) {{(pid=102472) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 07:57:23.875727 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_concurrency.lockutils [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 07:57:23.876498 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_concurrency.lockutils [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 07:57:23.878415 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_concurrency.lockutils [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 07:57:23.879763 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 07:57:23.881362 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 07:57:23.882256 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 07:57:23.884274 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 07:57:23.888892 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_db.sqlalchemy.engines [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:23.889723 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_db.sqlalchemy.engines [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:23.897176 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:23.899598 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:24.051834 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG oslo_db.sqlalchemy.engines [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:24.058292 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_db.sqlalchemy.engines [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 07:57:24.473390 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: WARNING keystonemiddleware.auth_token [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 07:57:24.480595 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: WARNING keystonemiddleware.auth_token [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 07:57:24.496889 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: WARNING keystonemiddleware.auth_token [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 07:57:24.503254 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: WARNING keystonemiddleware.auth_token [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 07:57:24.827341 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: WARNING keystonemiddleware.auth_token [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 07:57:24.832694 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: WARNING keystonemiddleware.auth_token [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 07:57:24.838333 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e5c3e49c0 pid: 102471 (default app) Jan 28 07:57:24.840413 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:57:24.841569 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jan 28 07:57:24.841985 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri Jan 28 07:57:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:57:24.872421 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: WARNING keystonemiddleware.auth_token [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 07:57:24.877518 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: WARNING keystonemiddleware.auth_token [None req-f6c723e3-8c6b-4bab-994c-b7eecfb76680 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 07:57:24.882800 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e5c3e49c0 pid: 102472 (default app) Jan 28 07:58:52.389427 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:58:52.390422 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 28 07:58:52.390828 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:58:52.827553 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-ba030ade-508a-4f0c-b200-20bb6f397d82 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:58:52.859785 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-ba030ade-508a-4f0c-b200-20bb6f397d82 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458580 Jan 28 07:58:52.859785 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jan 28 07:58:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:58:55.154666 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:58:55.155661 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-c516133e-970e-48e2-b0fd-e87fb26aae95 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 28 07:58:55.156229 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:58:55.216360 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-60c15c20-a92f-4152-a735-9c8337ad39b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:58:55.234186 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 07:58:55.234186 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 07:58:55.339105 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-60c15c20-a92f-4152-a735-9c8337ad39b6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.176974 Jan 28 07:58:55.339795 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:58:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:58:55.552730 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-f0635463-cb39-4916-ac77-c0a9bb7d614f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:58:55.555174 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 07:58:55.555174 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: warnings.warn(msg) Jan 28 07:58:55.671995 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-f0635463-cb39-4916-ac77-c0a9bb7d614f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.323827 Jan 28 07:58:55.673221 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jan 28 07:58:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:58:57.911396 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-60c15c20-a92f-4152-a735-9c8337ad39b6 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:58:57.912409 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-60c15c20-a92f-4152-a735-9c8337ad39b6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jan 28 07:58:57.912973 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:58:58.016482 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-45a157d5-ad0d-4b78-86e8-9d66b0113e8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:58:58.035593 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 07:58:58.035593 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: warnings.warn(msg) Jan 28 07:58:58.145060 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-45a157d5-ad0d-4b78-86e8-9d66b0113e8c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225772 Jan 28 07:58:58.145955 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:58:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:58:58.157566 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-3bd5a50f-b583-454a-8343-efb9bd65d876 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:58:58.159156 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 07:58:58.159156 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 07:58:58.285589 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-3bd5a50f-b583-454a-8343-efb9bd65d876 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131761 Jan 28 07:58:58.286530 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jan 28 07:58:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 07:59:00.575267 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-45a157d5-ad0d-4b78-86e8-9d66b0113e8c admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:00.576233 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-45a157d5-ad0d-4b78-86e8-9d66b0113e8c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jan 28 07:59:00.576631 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:00.636661 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-6c21476b-76c7-408f-8d19-ddef7c1d317c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:00.739377 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-6c21476b-76c7-408f-8d19-ddef7c1d317c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155939 Jan 28 07:59:00.740450 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:00.752950 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-a7a844eb-bf2f-47d4-b1c0-9ff3502dd120 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:00.833980 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-a7a844eb-bf2f-47d4-b1c0-9ff3502dd120 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085152 Jan 28 07:59:00.847270 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jan 28 07:59:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:03.101879 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-6c21476b-76c7-408f-8d19-ddef7c1d317c admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:03.102890 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-6c21476b-76c7-408f-8d19-ddef7c1d317c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 28 07:59:03.103485 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:03.178369 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-67f13da3-3dcc-4063-861d-ff2e96810a06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:03.256616 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-67f13da3-3dcc-4063-861d-ff2e96810a06 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147621 Jan 28 07:59:03.257176 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:59:03.269112 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-c4e55e56-2ded-4010-9e5b-84993e513fa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:03.370599 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-c4e55e56-2ded-4010-9e5b-84993e513fa3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105540 Jan 28 07:59:03.371201 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jan 28 07:59:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:05.618495 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-67f13da3-3dcc-4063-861d-ff2e96810a06 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:05.619535 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-67f13da3-3dcc-4063-861d-ff2e96810a06 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 28 07:59:05.620093 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:05.677251 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:05.807421 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.181056 Jan 28 07:59:05.808287 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:05.820492 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-0a780a38-13f3-4995-9267-7f28c16b5132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:05.917577 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-0a780a38-13f3-4995-9267-7f28c16b5132 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100648 Jan 28 07:59:05.918199 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jan 28 07:59:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:08.207579 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:08.209672 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003042 Jan 28 07:59:08.210413 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:08.321134 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-95c8ae40-28cd-453d-8f0d-d46213323c00 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:08.345371 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-95c8ae40-28cd-453d-8f0d-d46213323c00 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.128968 Jan 28 07:59:08.345932 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jan 28 07:59:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:10.648641 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:10.649659 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-f78311f5-bb14-43ae-82d2-f7ff306c9d8e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 28 07:59:10.650241 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:10.716912 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-cd8a60d2-0971-4471-8c6e-b5a57449c74b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:10.812230 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-cd8a60d2-0971-4471-8c6e-b5a57449c74b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.154892 Jan 28 07:59:10.812843 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:59:10.824990 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-85043fd4-be50-4d73-9647-90ff3c855ccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:10.899230 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-85043fd4-be50-4d73-9647-90ff3c855ccd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077866 Jan 28 07:59:10.899711 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jan 28 07:59:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:13.138383 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-cd8a60d2-0971-4471-8c6e-b5a57449c74b admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:13.139451 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-cd8a60d2-0971-4471-8c6e-b5a57449c74b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 28 07:59:13.139859 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:13.196696 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e53ccb78-e3e5-4444-a1e8-5065161690c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:13.278432 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e53ccb78-e3e5-4444-a1e8-5065161690c1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132394 Jan 28 07:59:13.278992 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:59:13.291210 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-058c5487-5aac-477f-b6ac-9b3d2aec39a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:13.369684 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-058c5487-5aac-477f-b6ac-9b3d2aec39a0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081840 Jan 28 07:59:13.370301 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jan 28 07:59:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:15.697730 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e53ccb78-e3e5-4444-a1e8-5065161690c1 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:15.698955 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e53ccb78-e3e5-4444-a1e8-5065161690c1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jan 28 07:59:15.699680 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:15.759005 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-b96f9b12-94d5-4184-8f2a-353be07f50af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "vcpus": 2}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:15.905152 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-b96f9b12-94d5-4184-8f2a-353be07f50af admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.198260 Jan 28 07:59:15.906155 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:15.918712 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-4329ff1e-5f45-466b-85f9-d1a7c68842ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:16.000035 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-4329ff1e-5f45-466b-85f9-d1a7c68842ba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084461 Jan 28 07:59:16.000628 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jan 28 07:59:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 07:59:18.412411 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-b96f9b12-94d5-4184-8f2a-353be07f50af admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:18.413584 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-b96f9b12-94d5-4184-8f2a-353be07f50af admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Jan 28 07:59:18.413993 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:18.484291 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e70a8467-9ff8-45db-b33a-b226a6b67e54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:18.561172 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e70a8467-9ff8-45db-b33a-b226a6b67e54 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140766 Jan 28 07:59:18.561915 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:18.575684 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-c98bcc90-d541-4bc0-a5b1-b36e1a33802b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:18.655421 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-c98bcc90-d541-4bc0-a5b1-b36e1a33802b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084254 Jan 28 07:59:18.656122 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jan 28 07:59:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:20.935519 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e70a8467-9ff8-45db-b33a-b226a6b67e54 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:20.937049 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e70a8467-9ff8-45db-b33a-b226a6b67e54 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jan 28 07:59:20.937453 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:20.995832 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:21.078197 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.134802 Jan 28 07:59:21.078788 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jan 28 07:59:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:21.090532 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-76c4731b-be65-47c2-bfeb-4e9b61089df5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:21.169694 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-76c4731b-be65-47c2-bfeb-4e9b61089df5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082658 Jan 28 07:59:21.170204 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jan 28 07:59:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 07:59:50.249393 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:50.250400 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jan 28 07:59:50.250797 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 07:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:50.305941 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-d5e50fa7-4ae6-4ee0-b920-ecdd6255ef1a admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:50.324957 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-d5e50fa7-4ae6-4ee0-b920-ecdd6255ef1a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068390 Jan 28 07:59:50.325508 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jan 28 07:59:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:51.692248 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:51.693254 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-10a6a391-7420-490c-b90c-61f55709cbdf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 28 07:59:51.693658 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:51.884364 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-4bca0fd0-d4b8-48c3-84b2-c4fac67bc7e6 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:51.890394 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.wsgi [None req-4bca0fd0-d4b8-48c3-84b2-c4fac67bc7e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 07:59:51.890962 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-4bca0fd0-d4b8-48c3-84b2-c4fac67bc7e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:51.891792 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-4bca0fd0-d4b8-48c3-84b2-c4fac67bc7e6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057576 Jan 28 07:59:51.892301 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jan 28 07:59:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 07:59:51.901790 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-c3bb64de-1e1e-4d32-bcf4-0df4e1a71d21 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:51.921693 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-c3bb64de-1e1e-4d32-bcf4-0df4e1a71d21 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023520 Jan 28 07:59:51.922243 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:51.931453 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-9b943120-3c21-4f4a-a267-b8bcc65eda4c admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:51.953307 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-9b943120-3c21-4f4a-a267-b8bcc65eda4c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024947 Jan 28 07:59:51.953969 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:51.963151 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-3ff351bd-218f-4256-ba63-5f87eb15feb3 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:51.968377 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.wsgi [None req-3ff351bd-218f-4256-ba63-5f87eb15feb3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 07:59:51.968934 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-3ff351bd-218f-4256-ba63-5f87eb15feb3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:51.969705 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-3ff351bd-218f-4256-ba63-5f87eb15feb3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010177 Jan 28 07:59:51.970187 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jan 28 07:59:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 07:59:53.233896 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-9b943120-3c21-4f4a-a267-b8bcc65eda4c admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:53.234938 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-9b943120-3c21-4f4a-a267-b8bcc65eda4c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 28 07:59:53.235363 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:53.423804 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-01dd4790-3155-49c6-8cc5-7ea575e8bb2d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:53.428907 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.wsgi [None req-01dd4790-3155-49c6-8cc5-7ea575e8bb2d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 07:59:53.429500 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-01dd4790-3155-49c6-8cc5-7ea575e8bb2d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:53.430285 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-01dd4790-3155-49c6-8cc5-7ea575e8bb2d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.056260 Jan 28 07:59:53.430794 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jan 28 07:59:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 07:59:53.440663 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-33e86753-2a1a-4c80-a846-757ccee9cab7 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:53.454368 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-33e86753-2a1a-4c80-a846-757ccee9cab7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017144 Jan 28 07:59:53.454830 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:53.463848 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-72fdc572-ec77-4b06-8b73-954fdfee6b89 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:53.476846 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-72fdc572-ec77-4b06-8b73-954fdfee6b89 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016441 Jan 28 07:59:53.477364 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:53.486525 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-5ec304ae-07e5-484d-b011-f91855e64eed admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:53.491635 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.wsgi [None req-5ec304ae-07e5-484d-b011-f91855e64eed admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 07:59:53.492210 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-5ec304ae-07e5-484d-b011-f91855e64eed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:53.492963 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-5ec304ae-07e5-484d-b011-f91855e64eed admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009822 Jan 28 07:59:53.493437 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jan 28 07:59:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 07:59:54.773667 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-72fdc572-ec77-4b06-8b73-954fdfee6b89 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:54.774709 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-72fdc572-ec77-4b06-8b73-954fdfee6b89 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 28 07:59:54.775101 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:54.964254 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-0416d388-e977-47cc-b85b-063dbcde04e6 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:54.969890 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.wsgi [None req-0416d388-e977-47cc-b85b-063dbcde04e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 07:59:54.970454 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-0416d388-e977-47cc-b85b-063dbcde04e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:54.971280 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-0416d388-e977-47cc-b85b-063dbcde04e6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057089 Jan 28 07:59:54.971777 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 07:59:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 07:59:54.980963 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-79b13c81-1c9d-4090-bb39-92a1e59ad1ed admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:54.994661 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-79b13c81-1c9d-4090-bb39-92a1e59ad1ed admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017202 Jan 28 07:59:54.995120 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 07:59:55.004381 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:55.017437 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016822 Jan 28 07:59:55.017957 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jan 28 07:59:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 07:59:55.026800 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-09a5b7db-ecbd-4d59-9a54-09d09bf7b938 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:55.032323 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.wsgi [None req-09a5b7db-ecbd-4d59-9a54-09d09bf7b938 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 07:59:55.032875 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-09a5b7db-ecbd-4d59-9a54-09d09bf7b938 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 07:59:55.033637 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-09a5b7db-ecbd-4d59-9a54-09d09bf7b938 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010297 Jan 28 07:59:55.034112 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 07:59:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 07:59:56.289193 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:56.290211 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jan 28 07:59:56.290613 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:56.479572 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-e0d8a311-78ca-4495-92ac-b745abfabc8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:56.552722 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-e0d8a311-78ca-4495-92ac-b745abfabc8b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122941 Jan 28 07:59:56.553271 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jan 28 07:59:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 07:59:57.883141 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:57.884161 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 28 07:59:57.884552 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:58.083542 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-369af542-02b3-43ca-8a2a-7af7263632ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:58.158381 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-369af542-02b3-43ca-8a2a-7af7263632ae admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124529 Jan 28 07:59:58.158845 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jan 28 07:59:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 07:59:59.439575 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 07:59:59.440583 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jan 28 07:59:59.440980 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 07:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 07:59:59.630945 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-7cdf91ab-aeb6-4870-92b0-92cf0321d004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 07:59:59.785098 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-7cdf91ab-aeb6-4870-92b0-92cf0321d004 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.203915 Jan 28 07:59:59.785640 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jan 28 07:59:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:00:01.048912 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:01.049945 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 28 08:00:01.050339 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:00:01.238617 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-fcd83392-1ea6-441d-910f-fe85cf60e7df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:00:01.352489 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-fcd83392-1ea6-441d-910f-fe85cf60e7df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.163923 Jan 28 08:00:01.353024 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jan 28 08:00:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:00:02.630358 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:02.631393 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jan 28 08:00:02.631790 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:00:02.831382 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-86868bf1-d884-4dfb-9152-738714429547 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:02.851217 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-86868bf1-d884-4dfb-9152-738714429547 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071236 Jan 28 08:00:02.851694 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri Jan 28 08:00:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:00:49.098730 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.099816 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-8a0f2ea8-8b82-4e6a-8f86-4b9988006dc0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 28 08:00:49.100217 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:00:49.158135 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-d3e2a24d-d8e4-42f8-85c3-5b4b5ba42f82 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.177340 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-d3e2a24d-d8e4-42f8-85c3-5b4b5ba42f82 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070994 Jan 28 08:00:49.177879 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:00:49.200376 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-2b0bf78c-5ba7-4d87-89c0-9fef24c3b1fc admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.208420 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-2b0bf78c-5ba7-4d87-89c0-9fef24c3b1fc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011736 Jan 28 08:00:49.208928 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:00:49.219872 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-6a2aa304-d2f5-4b68-9162-bdb3a9f0bd52 admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.227457 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-6a2aa304-d2f5-4b68-9162-bdb3a9f0bd52 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011086 Jan 28 08:00:49.227993 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:00:49.239696 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-4a56391c-6832-41f7-91db-506964593d6d admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.247823 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-4a56391c-6832-41f7-91db-506964593d6d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011656 Jan 28 08:00:49.248329 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:00:49.259277 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:00:49.266709 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010892 Jan 28 08:00:49.267276 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jan 28 08:00:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:02:44.856602 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e7d2859d-e303-433f-adba-e5cbaf4571fb tempest-verify_tempest_config-1715880680 tempest-verify_tempest_config-1715880680-project] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:02:44.858576 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e7d2859d-e303-433f-adba-e5cbaf4571fb tempest-verify_tempest_config-1715880680 tempest-verify_tempest_config-1715880680-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105365 Jan 28 08:02:44.859111 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jan 28 08:02:44 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:04:12.836708 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:12.837753 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 28 08:04:12.838151 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:04:13.088845 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:13.090012 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:04:13.090012 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 08:04:13.091569 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:13.092048 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:13.092855 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:13.093290 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:13.126724 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-659a6698-5420-40f1-a4f2-0c6b6d86accf admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.146219 Jan 28 08:04:13.127295 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 35/71] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 08:04:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:04:14.428628 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:14.429609 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001382 Jan 28 08:04:14.430002 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:04:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:04:14.620131 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:14.621300 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:04:14.621300 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 08:04:14.622816 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:14.623306 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:14.624101 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:14.624530 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:14.643577 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-d00e606f-69d5-46a9-b21e-3e1dfb4b9fcc admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073189 Jan 28 08:04:14.644111 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 36/73] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 08:04:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:04:26.362320 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:26.363367 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jan 28 08:04:26.363767 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:04:26.564205 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:26.565406 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:04:26.565406 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 08:04:26.566949 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:26.567423 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:26.568289 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:26.568705 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:26.592986 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-d392abd3-2274-437f-a0ca-62d41aa1c0f8 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080096 Jan 28 08:04:26.593472 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 37/75] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 08:04:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:04:27.868383 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: DEBUG nova.api.openstack.wsgi [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] Calling method '>' {{(pid=102471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:27.869382 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: INFO nova.api.openstack.requestlog [None req-8ad46b41-f7cc-4b83-99fd-d7d92500ea4d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 28 08:04:27.869787 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: [pid: 102471|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jan 28 08:04:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:04:28.064894 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG nova.api.openstack.wsgi [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] Calling method '>' {{(pid=102472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:04:28.066092 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:04:28.066092 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: warnings.warn(msg) Jan 28 08:04:28.068237 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:28.068682 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:28.069479 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:04:28.069908 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: DEBUG oslo_concurrency.lockutils [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:04:28.094637 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: INFO nova.api.openstack.requestlog [None req-e25aac23-2342-4768-ab72-2e3248486ada admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079882 Jan 28 08:04:28.095116 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: [pid: 102472|app: 0|req: 38/77] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jan 28 08:04:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:05:25.750501 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: Fri Jan 28 08:05:25 2022 - graceful shutdown triggered... Jan 28 08:05:25.750742 dv-cinder-804035-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 08:05:25.751447 dv-cinder-804035-28-iscsi devstack@n-api.service[102472]: Gracefully killing worker 2 (pid: 102472)... Jan 28 08:05:25.752363 dv-cinder-804035-28-iscsi devstack@n-api.service[102471]: Gracefully killing worker 1 (pid: 102471)... Jan 28 08:05:26.751740 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: worker 1 buried after 1 seconds Jan 28 08:05:26.751740 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: worker 2 buried after 1 seconds Jan 28 08:05:26.751740 dv-cinder-804035-28-iscsi devstack@n-api.service[102470]: goodbye to uWSGI. Jan 28 08:05:26.753245 dv-cinder-804035-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 08:05:26.753803 dv-cinder-804035-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 08:05:26.756693 dv-cinder-804035-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 08:05:26.765600 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 08:05:26.768310 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 08:05:26 2022] *** Jan 28 08:05:26.768473 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 08:05:26.768606 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 08:05:26.768720 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: nodename: dv-cinder-804035-28-iscsi Jan 28 08:05:26.768834 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: machine: x86_64 Jan 28 08:05:26.768946 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: clock source: unix Jan 28 08:05:26.769068 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: pcre jit disabled Jan 28 08:05:26.769179 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: detected number of CPU cores: 4 Jan 28 08:05:26.769287 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: current working directory: / Jan 28 08:05:26.769397 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: detected binary path: /usr/bin/uwsgi-core Jan 28 08:05:26.769519 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: your processes number limit is 47680 Jan 28 08:05:26.769719 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: your memory page size is 4096 bytes Jan 28 08:05:26.769834 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: detected max file descriptor number: 2048 Jan 28 08:05:26.770035 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: lock engine: pthread robust mutexes Jan 28 08:05:26.770315 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: thunder lock: enabled Jan 28 08:05:26.770622 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 08:05:26.770843 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 08:05:26.818510 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: Python main interpreter initialized at 0x561f8734c9c0 Jan 28 08:05:26.818510 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: python threads support enabled Jan 28 08:05:26.818510 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: your server socket listen backlog is limited to 100 connections Jan 28 08:05:26.818510 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: your mercy for graceful operations on workers is 90 seconds Jan 28 08:05:26.818952 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 08:05:26.818952 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: *** Operational MODE: preforking *** Jan 28 08:05:26.819220 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: *** uWSGI is running in multiple interpreter mode *** Jan 28 08:05:26.819220 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: spawned uWSGI master process (pid: 116929) Jan 28 08:05:26.820230 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: spawned uWSGI worker 1 (pid: 116947, cores: 1) Jan 28 08:05:26.819461 dv-cinder-804035-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 08:05:26.820447 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: spawned uWSGI worker 2 (pid: 116948, cores: 1) Jan 28 08:05:26.822148 dv-cinder-804035-28-iscsi devstack@n-api.service[116929]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 08:05:28.785660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 08:05:28.785660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: from cryptography.utils import int_from_bytes Jan 28 08:05:28.786289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 08:05:28.786289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: from cryptography.utils import int_from_bytes Jan 28 08:05:28.837272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 08:05:28.837272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: from cryptography.utils import int_from_bytes Jan 28 08:05:28.837946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 08:05:28.837946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: from cryptography.utils import int_from_bytes Jan 28 08:05:31.192392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 08:05:31.192815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 08:05:31.193272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 08:05:31.193536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 08:05:31.193793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 08:05:31.194187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.194523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.194851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.195178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.195555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.195872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.196268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.196662 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.196999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.197268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.197588 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.197985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-28-iscsi {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.198317 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.198634 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.198954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.199310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.199620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.199949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.200262 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.200766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.201219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.201538 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.201858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.202204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.202537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.202853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.203168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.203531 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.203861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.204177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.204603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-28-iscsi {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.204929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.205252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.205572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.205993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.206310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.206629 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.206955 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.207309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.207633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.207968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.208851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.209180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.209527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.209819 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.210135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.210451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.210778 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.211091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.211432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.211693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.212009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.212363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.212763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.213095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.213401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.214526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.214526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.214526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.214991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.218003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.219200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.220069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.220069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.220357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.220511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.220786 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.221114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.221431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.221782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.222055 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.222384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.222800 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.223034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.223314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.223631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.224528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.224873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.225195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.225510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.225828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.226138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.226452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.226767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.227087 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.227426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.227742 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.228056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.228373 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.228687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.229001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.229326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.229653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.229966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.230276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.230589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.230904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.231227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.231565 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.231890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.232198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.232511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.232825 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.233147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.233461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.233775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.234099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.234405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.234718 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.235049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.235383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.235698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.236009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.236320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.236631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.236942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.237252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.237562 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.237869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.238196 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.238523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.239042 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.239215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.239493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.239821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.240164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.240502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.240850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.241171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.241508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.241845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.242170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.242488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.242809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.243153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.243472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.243792 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.244112 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.244437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.244759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.245100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.245421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.245742 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.246604 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.246604 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.246936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.247083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.247415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.247736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.248083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.248432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.248755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.249088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.249410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.249740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.250062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.250382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.250705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.251119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.251387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.251707 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.252124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.252375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.252700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.253015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.253328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.253642 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.253945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.254258 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.254587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.254921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.255286 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.255694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.256012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.256334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.256655 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.256974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.257358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.257613 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.257934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.258247 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.258579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.258900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.259214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.259573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.259889 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.260204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.260528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.260849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.261225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.261489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.261823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.262143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.262464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.262806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.263144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.263485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.263821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.264155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.264479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.264793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.265121 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.265436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.265747 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.266060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.266382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.266693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.267026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.267350 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.267667 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.267978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.268309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.268628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.268941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.269253 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.269564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.269914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.270225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.270575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.271477 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.271910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.272130 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.272452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.272772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.273094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.273585 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.273768 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.274058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.274403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.274749 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.275074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.275492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.275760 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.276079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.276479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.276712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.277035 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.277380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.277724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.278047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.278376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.278694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.279014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.279356 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.279674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.279990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.280307 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.280629 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.280946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.281267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.281585 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.282015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.282223 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.282549 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.282857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.283016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 08:05:31.283545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.283795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 08:05:31.283960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.284214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 08:05:31.284418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.284573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 08:05:31.284719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.284879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 08:05:31.285026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.285179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.285331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.285483 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.285714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.285875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.286027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.286182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.286326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.287020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.287178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.287367 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.287523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.287687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.287910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.288067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.288360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.288548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.288728 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.288875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.289020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.289170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.289315 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.289458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-28-iscsi {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.289615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.289760 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.289913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.290065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.290216 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.290375 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.290543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.290695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.290848 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.290991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.291143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.291334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.291493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.291739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.291890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.291890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.292321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.292494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.292745 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.292897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.293041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.293201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.293440 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.293599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.293753 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.294014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.294174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.294328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.294820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.294971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.295141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.295328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.295487 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.295640 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.295870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.296033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.296188 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.296342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.296495 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-28-iscsi {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.296648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.296808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.296952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.297103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.297264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.297264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.297545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.297775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.297946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.298169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.298317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.298469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.298613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.298768 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.298913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.299056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.299207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.299405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.299560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.299714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.299859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.300010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.300162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.300306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.300457 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.300609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.300753 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.300898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.301041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.301201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.301360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.301505 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.301663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.301900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.302074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.302357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.302518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.302518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.302896 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.303056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.303207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.303406 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.303563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.303714 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.303858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.304021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.304265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.304425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.304574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.304718 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.304974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.305127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.305273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.305427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.305604 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.305757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.305989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.306149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.306309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.306454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.306597 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.306740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.306890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.307034 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.307192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.307385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.307550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.307703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.307855 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.308006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.308183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.308400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.308550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.308702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.308854 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.308999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.309159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.309314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.309465 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.309621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.309780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.309926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.310077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.310077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.310359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.310359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.310641 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.310785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.310927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.311070 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.311213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.311422 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.311579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.311733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.311903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.312131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.312434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.312587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.312731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.312903 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.313134 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.313292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.313447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.313601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.313763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.313908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.314062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.314207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.314534 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.320448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.320650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.320818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.320970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.321125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.321287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.329587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.330480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.330663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.330843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.330995 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.331159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.331603 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.331770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.331928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.332083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.332229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.332374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.332518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.332670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.332827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.332981 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.333127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.333814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.333975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.334126 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.334284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.334445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.334604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.334755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.334921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.335072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.335231 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.335438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.335591 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.335740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.335890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.336038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.336197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.336347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.336497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.336646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.336795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.336943 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.337112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.337282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.337823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.337984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.338146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.338299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.338461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.338614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.338772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.338932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.339083 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.339233 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.339436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.339587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.339737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.340153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.340321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.340484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.340635 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.340793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.340952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.341104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.341253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.341421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.341994 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.342207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.342407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.342618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.342806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.343038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.343239 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.343457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.343653 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.343852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.344048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.344235 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.344421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.344630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.344819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.345014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.345220 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.345407 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.345594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.345789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.345986 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.346183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.346371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.346557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.346759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.346957 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.347161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.347385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.347385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.348085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.348261 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.348414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.348577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.348735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.349466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.349633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 08:05:31.349796 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.349956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.350931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.351090 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.351260 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.351422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.351591 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.351855 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.352184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.352353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.352505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.352655 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.352831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353321 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.353949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.354889 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355576 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.355877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356241 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.356895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.357053 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.357215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.357215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.357521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.357673 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.358198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.358374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.358535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.358695 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.358860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359180 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.359991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360148 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.360947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.361106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.361269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.361428 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.361602 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.361762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.362001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.362346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.362515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.362670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.362835 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.363134 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.363325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.364889 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365668 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.365832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366440 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.366758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.367183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.367407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.367596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.367793 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.368267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.368462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.368661 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.368856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.369204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.369405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.369605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.369800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.369999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.370198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.370394 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.370564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.370725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.370884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371371 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.371842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.372024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.372274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.372601 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.372770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.372930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.373151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.373418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.373577 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.373735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.373893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.374997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.375351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.375516 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.375665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.375665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.375956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.376120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.376286 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.376436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.376706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.376886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377511 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.377978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.378152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.378518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.378687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.378843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.378999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.379180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.379481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.379652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.379804 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.379962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380319 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380790 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.380952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.381185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.381367 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.381651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.381817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.381969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.382134 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.382390 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.382650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.382898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.383959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.384890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.385864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.386530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.386692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.386860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387503 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.387974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.388136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.388286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.388691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.388863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.389026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.389186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.389345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.389521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.389766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390309 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.390777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.391078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.391228 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.391456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.391632 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.391863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.392036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.392206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.392378 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.392620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.392854 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.393022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.393183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.393334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.393492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.393852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394343 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394495 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.394951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.395109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.395295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.395463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.395627 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396320 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396646 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.396957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.397252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.397252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.397252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.397252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.397848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398315 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.398779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.399090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.399257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.399450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.399609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.399777 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.400930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401871 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.401871 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.402252 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.402418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.402599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.402849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.403079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.403292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.403467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.403629 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.403878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404448 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.404922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.405863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406013 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406799 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.406950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407279 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407438 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.407900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.408071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.408316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.408488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.408660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.408952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.409897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410470 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.410932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.411234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.411986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.412224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.412381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.412531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.412690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.412880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.413121 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.413350 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.413508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.413659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.413836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.414635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415064 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415697 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.415867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.416977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417135 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417296 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417781 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.417930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.418837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.419132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.419335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.419743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.419909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.420953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.421726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.422986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.423230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.423230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.423630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.424573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.424740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.424893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425391 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.425856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426738 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.426896 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.427969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428278 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.428910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.429243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.429413 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.429574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.429777 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.429942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430253 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.430866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.431979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.432145 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.432305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.432558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.432736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.432897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.433058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.433228 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.433501 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.433759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.433940 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.434119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.434272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.434450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.434820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.434989 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435800 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.435951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.436110 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.436281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.436441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.436606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.436991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437163 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437317 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437794 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.437954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438275 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438766 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.438950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439510 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.439948 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.440758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441549 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441722 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441822 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.441921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.442937 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443023 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443914 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.443999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444091 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444261 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444538 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444623 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444879 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.444982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445613 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445705 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.445972 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446233 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446324 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446597 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446689 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.446940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447374 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447637 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.447990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448259 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448350 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.448712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.449849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450270 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450629 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450714 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.450902 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451266 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.451951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452364 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452531 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.452921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453084 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453167 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453354 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453788 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.453958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454246 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454344 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.454756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455463 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455762 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.455953 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456899 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.456984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457115 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457294 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457377 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.457985 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.458077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.458678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.458773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.458870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.458956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.459536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.460732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.461928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.462478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.462478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.462478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.462478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.462478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.463118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.463484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.463806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.464125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.464461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.464780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.465114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.465487 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.465770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.466229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.466631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.466879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.467200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.467825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.468242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.468719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.469245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.469659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.469984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.470332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.470724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.471032 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.471404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.471745 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.472076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.472409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.472746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.473065 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_db.sqlalchemy.engines [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.473201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.473365 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.473686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.474598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.474920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.475238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.475697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.475892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.476206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.476520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.476854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.477169 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.477504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.477824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.478138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.478468 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.478762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.479115 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.479455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.479794 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.480124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.480454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.480791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.481111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.481441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.481792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.482119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.482439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.482791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.483118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.483485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.483810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.484130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.484454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.484776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.485100 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.485671 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.486007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.486331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.486654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.486978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.487323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.487648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.487970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.488290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.488610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.488931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.489265 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.489638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.489970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.490317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.490641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.490963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.491307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.491633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.491998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.492320 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.492636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.492961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.493283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.493604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.494013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.494244 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.494564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.494882 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.495199 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.495539 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.495860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.496179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.496508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.496849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.497178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.497500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.497819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.498142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.498663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.498984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.499368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.499701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.500029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.500355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.500674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.501006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.501320 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.501632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.501951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.502271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.502581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.502911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.503234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.503572 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.503901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.504218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.504757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.505144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.505476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.505792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.506124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.506451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.506762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.507094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.507432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.507748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.508071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.508388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.508700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.509626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.509958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.510299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.510597 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.510920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.511234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.511593 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.511909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.512224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.512540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.512860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.513179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.513496 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.513807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.514119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.514437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.514750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.515071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.515414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.515727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.516035 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.516353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.516666 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.516996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.517312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.517627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.517952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.518323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.518660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.518979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.519318 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.519674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.520000 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.521345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.521689 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.522018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.522360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.522702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.523017 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.523331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.523649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.524021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.524341 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.524662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.524996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.525300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.525621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.525942 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.526257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.526575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.526893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.527209 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.528489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.528827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.529183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.529517 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.529848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.530178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.530613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.530854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.531173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.531522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.531842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.532167 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.532505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.532828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.533140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.533602 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.533932 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.534261 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.534650 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.534943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.535297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.535659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.535977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.536420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.537251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.537589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.537936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.538275 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.538608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.538924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.539139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.context [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38a2885c-64c6-4bdb-8906-386a5b1cde09(cell1) {{(pid=116948) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 08:05:31.539236 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.539565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.539884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.540221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.540561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.540890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.541217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.541535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.541864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.542185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.542514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.542846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.543172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.543518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.543795 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:05:31.543907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.544171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.544741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.545061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.545381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.545679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:05:31.545776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.546086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.546335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.546539 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:05:31.546670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.546983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.547335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.547664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.547991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.548315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.548501 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:05:31.548634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.548970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.549285 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.549608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.549925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.550241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.550562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.550964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.551204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.551565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.551897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.552254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.552610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.552929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.553282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.553614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.553960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.554469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.554792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 08:05:31.555042 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 08:05:31.558998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_db.sqlalchemy.engines [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.560251 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_db.sqlalchemy.engines [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.578145 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_db.sqlalchemy.engines [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.640272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.context [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38a2885c-64c6-4bdb-8906-386a5b1cde09(cell1) {{(pid=116947) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 08:05:31.644504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:05:31.646743 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:05:31.647574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:05:31.649482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:05:31.660190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_db.sqlalchemy.engines [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.661970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_db.sqlalchemy.engines [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.723386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_db.sqlalchemy.engines [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:31.822077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_db.sqlalchemy.engines [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 08:05:32.043571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: WARNING keystonemiddleware.auth_token [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 08:05:32.051198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: WARNING keystonemiddleware.auth_token [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 08:05:32.138190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: WARNING keystonemiddleware.auth_token [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 08:05:32.145154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: WARNING keystonemiddleware.auth_token [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 08:05:32.395007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: WARNING keystonemiddleware.auth_token [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 08:05:32.400398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: WARNING keystonemiddleware.auth_token [None req-7be01b09-ec4f-4fd9-8fff-25ae25a24300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 08:05:32.405579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f8734c9c0 pid: 116948 (default app) Jan 28 08:05:32.485148 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: WARNING keystonemiddleware.auth_token [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 08:05:32.491056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: WARNING keystonemiddleware.auth_token [None req-6390c92b-b461-4f15-bc26-1acfc3128b8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 08:05:32.496242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f8734c9c0 pid: 116947 (default app) Jan 28 08:06:08.974449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4b40e119-a90c-4f2d-a16e-7edb9ef83002 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Action: 'create', calling method: .version_select at 0x7f34756c4ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-199429218", "metadata": {"Type": "work"}}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:08.976939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4b40e119-a90c-4f2d-a16e-7edb9ef83002 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:08.978030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4b40e119-a90c-4f2d-a16e-7edb9ef83002 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.189998 Jan 28 08:06:08.983238 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jan 28 08:06:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 08:06:09.290054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e9ab25f6-9293-4816-b12e-80fae74232bf tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Action: 'create', calling method: .version_select at 0x7f34757118b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2068113203", "metadata": {"Type": "work"}}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:09.296357 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e9ab25f6-9293-4816-b12e-80fae74232bf tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:09.307130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e9ab25f6-9293-4816-b12e-80fae74232bf tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.313121 Jan 28 08:06:09.307553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jan 28 08:06:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:06:09.311404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-62e6ff95-0623-4136-a6aa-664d0318dbee tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Action: 'create', calling method: .version_select at 0x7f3475626820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1130611588", "metadata": {"Type": "work"}}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:09.312802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-62e6ff95-0623-4136-a6aa-664d0318dbee tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:09.314243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-62e6ff95-0623-4136-a6aa-664d0318dbee tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006096 Jan 28 08:06:09.315061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jan 28 08:06:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:06:09.327830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-699514a0-8f0c-4895-82ca-c23b76d1b322 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Calling method '.version_select at 0x7f34756c4dc0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:09.727621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-81344228", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "b961ad58-0562-480d-9a8e-4d9280c8a5d0"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:10.083775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] validate_networks() for [('b961ad58-0562-480d-9a8e-4d9280c8a5d0', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:10.182931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-699514a0-8f0c-4895-82ca-c23b76d1b322 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] HTTP exception thrown: Volume tempest-invalid-1978263198 could not be found. Jan 28 08:06:10.183949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-699514a0-8f0c-4895-82ca-c23b76d1b322 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 404 to user: Volume tempest-invalid-1978263198 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:10.184814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-699514a0-8f0c-4895-82ca-c23b76d1b322 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1978263198" status: 404 len: 99 microversion: 2.1 time: 0.860541 Jan 28 08:06:10.189508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1217 bytes} [Fri Jan 28 08:06:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1978263198 => generated 99 bytes in 869 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 28 08:06:10.201237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-286976ac-913b-4b02-93f6-f77a925ee076 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004439 Jan 28 08:06:10.205489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 4/5] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jan 28 08:06:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 08:06:10.211654 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e08ef738-b496-4e46-a267-24ed874049ee tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004914 Jan 28 08:06:10.215239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 5/6] 10.222.0.42 () {58 vars in 1136 bytes} [Fri Jan 28 08:06:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 08:06:10.224921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d881a3d9-cf77-4ec0-97d9-aaa20d493a20 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Calling method '.version_select at 0x7f34755ba3a0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:10.359824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-d881a3d9-cf77-4ec0-97d9-aaa20d493a20 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] HTTP exception thrown: Volume df0e6851-2eb9-4739-8de8-01c02632611c could not be found. Jan 28 08:06:10.360524 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d881a3d9-cf77-4ec0-97d9-aaa20d493a20 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 404 to user: Volume df0e6851-2eb9-4739-8de8-01c02632611c could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:10.361318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d881a3d9-cf77-4ec0-97d9-aaa20d493a20 tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/df0e6851-2eb9-4739-8de8-01c02632611c" status: 404 len: 109 microversion: 2.1 time: 0.141963 Jan 28 08:06:10.362317 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 6/7] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:06:10 2022] DELETE /compute/v2.1/os-volumes/df0e6851-2eb9-4739-8de8-01c02632611c => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:06:10.371963 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2634fe3d-f304-4277-965f-81f3beeb8e2f tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Calling method '.version_select at 0x7f34755304c0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:11.133082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-2634fe3d-f304-4277-965f-81f3beeb8e2f tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] HTTP exception thrown: Volume 11978d2b-395b-46fa-b1be-d0dcbbc96e08 could not be found. Jan 28 08:06:11.133696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2634fe3d-f304-4277-965f-81f3beeb8e2f tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] Returning 404 to user: Volume 11978d2b-395b-46fa-b1be-d0dcbbc96e08 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:06:11.140676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2634fe3d-f304-4277-965f-81f3beeb8e2f tempest-VolumesNegativeTest-75743518 tempest-VolumesNegativeTest-75743518-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/11978d2b-395b-46fa-b1be-d0dcbbc96e08" status: 404 len: 109 microversion: 2.1 time: 0.767562 Jan 28 08:06:11.140676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 7/8] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:06:10 2022] GET /compute/v2.1/os-volumes/11978d2b-395b-46fa-b1be-d0dcbbc96e08 => generated 109 bytes in 769 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:06:11.226288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-276178598", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "5bbf0488-5524-4350-a0ae-25b318852608"}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:11.422999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:11.424310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:11.425151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:11.425701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:11.426404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:11.446813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] validate_networks() for [('5bbf0488-5524-4350-a0ae-25b318852608', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:11.453317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:11.453799 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:11.454639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:11.456427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:11.488132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:11.495755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for user cf2c7ab19f374ad39a5c0f21e4e24835 and project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:11.509431 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:11.512528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:11.694456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7a4815da-a695-4904-a50c-32990b276f09 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.385465 Jan 28 08:06:11.695197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 2/9] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:06:11.708685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e480232c-0a03-45fc-b3a8-5311c556d436 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:11.709417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e480232c-0a03-45fc-b3a8-5311c556d436 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:11.870323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e480232c-0a03-45fc-b3a8-5311c556d436 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:11.891079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e480232c-0a03-45fc-b3a8-5311c556d436 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1216 microversion: 2.1 time: 0.189059 Jan 28 08:06:11.895571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 3/10] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:11 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:12.911683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d89cca08-e5d0-4f24-8962-2e5287d20db6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:12.914354 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d89cca08-e5d0-4f24-8962-2e5287d20db6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:13.137638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d89cca08-e5d0-4f24-8962-2e5287d20db6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:13.261988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d89cca08-e5d0-4f24-8962-2e5287d20db6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1216 microversion: 2.1 time: 0.239476 Jan 28 08:06:13.261988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 4/11] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:12 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1216 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:13.343927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:13.348733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:13.349295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:13.349701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:13.350285 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:13.382114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:13.382991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:13.384491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:13.385224 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:13.515599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Getting quotas for project bb0f221dadd24c88b4fb86e98b01d2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:13.515599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Getting quotas for user 13efd3ecae224a0a93ea82499852061f and project bb0f221dadd24c88b4fb86e98b01d2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:13.515599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:13.535612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:13.900669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2041dd35-95e7-4ab4-a84a-78675ce26ea0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.762245 Jan 28 08:06:13.904374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 8/12] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:06:13.912911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b5f96466-c108-41d4-91ed-f0eff64a7df9 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:13.913343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b5f96466-c108-41d4-91ed-f0eff64a7df9 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:14.167082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:14.167982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:14.204181 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:14.204698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:14.205560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:14.206025 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:14.485812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b5f96466-c108-41d4-91ed-f0eff64a7df9 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:14.492061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b5f96466-c108-41d4-91ed-f0eff64a7df9 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1214 microversion: 2.1 time: 0.583663 Jan 28 08:06:14.499287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 5/13] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:13 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1214 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:15.009630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:15.058413 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b33365ce-53f7-485d-a4d5-df85943cd855 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1220 microversion: 2.1 time: 0.895979 Jan 28 08:06:15.059002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 9/14] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:14 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1220 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:15.515524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-633f6efe-a87b-4b99-8dd8-9b9caee74fc0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:15.516816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-633f6efe-a87b-4b99-8dd8-9b9caee74fc0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:15.910024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-633f6efe-a87b-4b99-8dd8-9b9caee74fc0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:15.910024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-633f6efe-a87b-4b99-8dd8-9b9caee74fc0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1214 microversion: 2.1 time: 0.120087 Jan 28 08:06:15.910024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 6/15] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:15 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:16.075640 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:16.077111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:16.090193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:16.090665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:16.099219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:16.100167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:16.415862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:16.426088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-971260a8-a7ce-4526-b80b-395bd1365110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1212 microversion: 2.1 time: 0.354334 Jan 28 08:06:16.426684 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 10/16] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:16 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1212 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:16.648731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-507902ae-1496-4109-809e-c1544e9ae34f tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:16.649350 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-507902ae-1496-4109-809e-c1544e9ae34f tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:16.835646 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-507902ae-1496-4109-809e-c1544e9ae34f tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:16.852848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-507902ae-1496-4109-809e-c1544e9ae34f tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1214 microversion: 2.1 time: 0.207612 Jan 28 08:06:16.867615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 7/17] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:16 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:17.442697 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:17.443363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:17.449289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:17.450669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:17.451712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:17.452380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:17.540116 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:17.549652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-62f19e25-13f5-4541-bd10-6878472bf596 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1276 microversion: 2.1 time: 0.110809 Jan 28 08:06:17.586340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 11/18] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:17 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:17.871575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:17.872223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:17.880251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:17.880664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:17.881446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:17.881876 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:18.333191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:18.357584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9ecaf15f-fb83-40c2-878f-6f08a8f5a2c1 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1210 microversion: 2.1 time: 0.490263 Jan 28 08:06:18.361452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 8/19] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:17 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1210 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:18.569048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:18.569671 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:18.578081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:18.580156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:18.584258 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:18.588757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:19.146088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:19.155265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7deb3ca1-2900-45e3-87a4-689c5a59a0ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1274 microversion: 2.1 time: 0.590511 Jan 28 08:06:19.169765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:18 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1274 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:19.375719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:19.376413 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:19.387303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:19.394698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:19.396210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:19.398155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:19.887046 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:19.912645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7dc688c7-da39-4083-b827-a7d33ee78bb8 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1266 microversion: 2.1 time: 0.540671 Jan 28 08:06:19.913265 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 9/21] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:19 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1266 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:20.178518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:20.179694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:20.192034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:20.195303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:20.196305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:20.196957 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:20.700488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1708438321", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:20.844311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] validate_networks() for [('b8712f3c-c44d-4508-ab47-3dd2b43685fc', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:21.152517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:21.162138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-12ef1c8a-49ad-4e07-91d6-3fd6ee791d01 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.988013 Jan 28 08:06:21.168338 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:20 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:21.173905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:21.186328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:21.192275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:21.192727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:21.193526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:21.193966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:21.418731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:21.426532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4c1a7898-4f31-4660-90c9-48fd756a4dab tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1266 microversion: 2.1 time: 0.256132 Jan 28 08:06:21.430412 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:21 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:22.027914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: .version_select at 0x7f347551aee0>, body: {"keypair": {"name": "tempest-keypair-921541166"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:22.052434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:22.052960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:22.053323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:22.053736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:22.054156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:22.067174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:22.067711 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.068174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.069000 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.069443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.076738 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:22.088886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Getting quotas for project 77e5b26ca56447bdb1d7c4219d7c2598. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:22.093154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Getting quotas for user ea882dbe6dd54791938e3bafd74cdeb6 and project 77e5b26ca56447bdb1d7c4219d7c2598. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:22.112467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:22.116164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:22.314634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b544cfcd-d25c-4a0b-8f54-0e9d92ccd085 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.865334 Jan 28 08:06:22.321032 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 10/24] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:06:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:06:22.326640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:22.327481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:22.335444 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.336181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.337147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.337776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.676726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:22.692967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:22.693074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:22.705668 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-236ef425-ef4e-46ed-964c-cee82ccdab9b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.383170 Jan 28 08:06:22.706463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:22 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:22.715919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ebcff4c0-7d8c-45ec-a0b5-d339785234cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.805494 Jan 28 08:06:22.716742 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 15/26] 10.222.0.42 () {62 vars in 1198 bytes} [Fri Jan 28 08:06:21 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 808 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 08:06:22.723583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:22.724566 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:22.738447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-41beb966-00e4-45db-b900-b45447a1d9c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:22.757203 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-41beb966-00e4-45db-b900-b45447a1d9c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:22.760730 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.761188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.762002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:22.762461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:22.936544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-41beb966-00e4-45db-b900-b45447a1d9c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:22.943741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-41beb966-00e4-45db-b900-b45447a1d9c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1222 microversion: 2.1 time: 0.235471 Jan 28 08:06:22.952313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 12/27] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:22 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:23.104022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-548021924", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:23.167112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] validate_networks() for [('b8712f3c-c44d-4508-ab47-3dd2b43685fc', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:23.297679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:23.309921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-61193f0b-50a4-4301-8c68-5770500c8e5b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1266 microversion: 2.1 time: 0.591624 Jan 28 08:06:23.334523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 16/28] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:22 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1266 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:23.931010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: .version_select at 0x7f347433d820>, body: {"keypair": {"name": "tempest-keypair-1554948144"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:23.973283 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:23.988731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:24.156397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:24.156397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:24.156397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:24.156397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:24.156397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:24.164594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:24.165392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:24.170229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:24.171198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:24.231736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Getting quotas for project 77e5b26ca56447bdb1d7c4219d7c2598. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:24.241514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Getting quotas for user ea882dbe6dd54791938e3bafd74cdeb6 and project 77e5b26ca56447bdb1d7c4219d7c2598. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:24.297205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:24.327807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:24.678709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f01bffab-4667-4bc8-88ae-dd17ed6e4416 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.579017 Jan 28 08:06:24.682245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 13/29] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:06:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 08:06:24.693663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:24.702585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:24.738989 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:24.742904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:24.744143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:24.746813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:25.740770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:25.779068 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:25.852250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ccaf2c60-569e-4cef-a729-602a496b2fb9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.136369 Jan 28 08:06:25.854161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 17/30] 10.222.0.42 () {60 vars in 1157 bytes} [Fri Jan 28 08:06:23 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:25.869912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:25.879376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:25.892603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:25.897279 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:25.900298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:25.906435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:27.521609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:27.542072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-303378a3-ab3f-413f-aafb-f914b4a86ca0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 1.685813 Jan 28 08:06:27.543433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 18/31] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:25 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:27.552589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:27.553587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:27.569137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:27.569137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:27.570836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:27.571644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:27.597453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:27.605696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-54a78ba5-bc4a-4a71-8ac8-f70ff68b4acc tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 2.918446 Jan 28 08:06:27.616103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 14/32] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:24 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:27.736347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:27.753826 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2c135d2a-bb09-4a92-9263-c5c810a5e539 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1217 microversion: 2.1 time: 0.209119 Jan 28 08:06:27.755701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:27 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:28.562726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:28.563716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:28.611455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:28.612894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:28.614182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:28.636880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:28.639075 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:28.653636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:28.687447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:28.688353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:28.696213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:28.718968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:29.758543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:29.758543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-96610ab6-0c84-494c-8647-d38f7bf89618 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 1.197875 Jan 28 08:06:29.758543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:28 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:29.791356 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:29.792241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:29.812925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:29.816340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:29.817913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:29.821463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:30.364692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:30.373672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c2cd9569-c2c6-4762-9ade-1cf398a8d1ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1281 microversion: 2.1 time: 0.605971 Jan 28 08:06:30.374430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 16/35] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:29 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1281 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:30.656016 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:30.672022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ac0d07b3-bc9d-4b31-970c-d07da500462a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 2.042611 Jan 28 08:06:30.676544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:28 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:30.774993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:30.776681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:30.787796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:30.793605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:30.794909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:30.798805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.186645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-5bf83937-de30-43a7-9a83-17ca50394d14 req-cfe85489-24b1-4d0b-a6fb-fe6142252c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0612c4-618b-450a-a6dc-bd226fcde646", "tag": "1758b189-1edc-4faa-9a0d-821aa50b7283"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:31.192113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:31.192113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:06:31.217756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-5bf83937-de30-43a7-9a83-17ca50394d14 req-cfe85489-24b1-4d0b-a6fb-fe6142252c14 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.218488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-5bf83937-de30-43a7-9a83-17ca50394d14 req-cfe85489-24b1-4d0b-a6fb-fe6142252c14 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.261358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-5bf83937-de30-43a7-9a83-17ca50394d14 req-cfe85489-24b1-4d0b-a6fb-fe6142252c14 service nova] Creating event network-changed:1758b189-1edc-4faa-9a0d-821aa50b7283 for instance cc0612c4-618b-450a-a6dc-bd226fcde646 on hv-cinder-80403 Jan 28 08:06:31.262312 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-5bf83937-de30-43a7-9a83-17ca50394d14 req-cfe85489-24b1-4d0b-a6fb-fe6142252c14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 08:06:31.263957 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.264577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.265807 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.266605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.278913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.compute.rpcapi [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 08:06:31.282345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] Releasing lock "compute-rpcapi-router" {{(pid=116948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 08:06:31.332410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5bc6c325-c338-4f72-a549-49ce4ced42fd None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266882 Jan 28 08:06:31.334113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 21/37] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:31.441850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:31.441850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:31.441850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.441850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.442933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.442933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.630696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:31.667230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-70ca318b-4e57-4e7a-a495-3f9fafaaeb23 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1279 microversion: 2.1 time: 0.276532 Jan 28 08:06:31.670468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:31 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1279 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:31.693818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:31.694920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:31.710029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.710856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:31.712860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:31.715096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:32.536912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:32.556426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-414611f1-37c3-44cc-8638-54c6344da918 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.865881 Jan 28 08:06:32.567060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:31 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:32.641725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:32.649609 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-01baccb8-d80c-49d3-a9c8-8bd447bb4e94 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 1.879149 Jan 28 08:06:32.673582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 17/40] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:30 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:32.693464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:32.695055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:32.711667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:32.713761 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:32.715218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:32.715910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:32.787920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-3c7e473c-82d9-4d65-8298-f387a74c7f07 req-2f061233-748e-4451-a567-2485778c74cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c754703c-7e85-477c-a969-1c629a198cd3", "tag": "7c16c6b5-0b52-4684-817d-70da66045d63"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:32.790147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:32.790147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:06:32.798440 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-3c7e473c-82d9-4d65-8298-f387a74c7f07 req-2f061233-748e-4451-a567-2485778c74cd service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:32.799097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-3c7e473c-82d9-4d65-8298-f387a74c7f07 req-2f061233-748e-4451-a567-2485778c74cd service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:32.814614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-3c7e473c-82d9-4d65-8298-f387a74c7f07 req-2f061233-748e-4451-a567-2485778c74cd service nova] Creating event network-changed:7c16c6b5-0b52-4684-817d-70da66045d63 for instance c754703c-7e85-477c-a969-1c629a198cd3 on hv-cinder-80403 Jan 28 08:06:32.825568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-3c7e473c-82d9-4d65-8298-f387a74c7f07 req-2f061233-748e-4451-a567-2485778c74cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256317 Jan 28 08:06:32.825888 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 24/41] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:32.987878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:32.999796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6c2ab955-e71a-49d7-b7d9-9cc314c235d8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1279 microversion: 2.1 time: 0.310296 Jan 28 08:06:33.074847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:32 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:33.574515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:33.575230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:33.586713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:33.587448 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:33.589902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:33.590508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:33.671863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:33.672586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:33.682816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:33.683293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:33.684131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:33.684565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:34.535549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:34.539442 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-53ecc280-fbcf-4301-8750-731233914272 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.875531 Jan 28 08:06:34.540025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:33 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:34.559920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:34.560870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:34.570372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:34.573680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:34.574734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:34.576529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:34.628111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:34.641783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ab4ed7e5-88b5-4102-a789-2bd17c419d46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 1.071309 Jan 28 08:06:34.649518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 25/44] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:33 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:34.977552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1336926377", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f1cf5d-60d2-41bd-aebf-58b952073da1"}], "security_groups": [{"name": "tempest-securitygroup--689811405"}], "key_name": "tempest-keypair-921541166", "user_data": "}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:35.099661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:35.114096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fc7fb97a-0232-4e38-9c04-220518d2d1cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.568598 Jan 28 08:06:35.123561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 20/45] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:34 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:35.450322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] validate_networks() for [('71f1cf5d-60d2-41bd-aebf-58b952073da1', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:35.559773 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:35.644256 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:35.644256 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:35.644256 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:35.644256 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:35.645720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.256613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:36.270431 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d7acfb95-f213-4e06-ac50-7e338df04bc2 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.717152 Jan 28 08:06:36.283363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 21/46] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:35 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:36.307286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:36.308095 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:36.322316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.324393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.325837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.327950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.594297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:36.607892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2aa651e3-e930-45f3-ac59-8115a604e8ba tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.323915 Jan 28 08:06:36.621717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:36 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:36.645877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:36.646721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:36.664403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.664403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.664403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.664403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.933965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:36.942588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a9319796-1c4e-4344-b469-b890f519d151 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.327559 Jan 28 08:06:36.943171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:36 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:36.947883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-ef13b4f8-3ad4-4bd2-893d-d4e1334679b8 req-867b62da-809f-4ae5-9e7f-377a371ad029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f4c98-79fa-43de-9457-1e3b5bc6e93c", "tag": "795f771c-454b-4288-b77b-9f274f0cb6d5"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:36.950085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:36.950085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:06:36.961056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ef13b4f8-3ad4-4bd2-893d-d4e1334679b8 req-867b62da-809f-4ae5-9e7f-377a371ad029 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.961514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ef13b4f8-3ad4-4bd2-893d-d4e1334679b8 req-867b62da-809f-4ae5-9e7f-377a371ad029 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.980240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-ef13b4f8-3ad4-4bd2-893d-d4e1334679b8 req-867b62da-809f-4ae5-9e7f-377a371ad029 service nova] Creating event network-changed:795f771c-454b-4288-b77b-9f274f0cb6d5 for instance 449f4c98-79fa-43de-9457-1e3b5bc6e93c on hv-cinder-80403 Jan 28 08:06:36.981728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ef13b4f8-3ad4-4bd2-893d-d4e1334679b8 req-867b62da-809f-4ae5-9e7f-377a371ad029 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116947) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 08:06:36.981944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.982310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.983099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:36.983560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:36.992127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.compute.rpcapi [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 08:06:36.993030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=116947) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 08:06:37.021982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-936aae13-350c-4fa8-9ab5-72325f00a5e4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077322 Jan 28 08:06:37.022718 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 24/49] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:37.028326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-5578c065-464e-4088-88b9-f08341024a87 req-f6cdef25-73f1-4255-b6d4-9be9d287236d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e823ff-de17-4756-8990-8c2cdc9bd349", "tag": "e58b3f10-73a3-40b4-82c2-b1ce7b965488"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:37.030371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:37.030371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:06:37.038324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-5578c065-464e-4088-88b9-f08341024a87 req-f6cdef25-73f1-4255-b6d4-9be9d287236d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.039078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-5578c065-464e-4088-88b9-f08341024a87 req-f6cdef25-73f1-4255-b6d4-9be9d287236d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.050997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-5578c065-464e-4088-88b9-f08341024a87 req-f6cdef25-73f1-4255-b6d4-9be9d287236d service nova] Creating event network-changed:e58b3f10-73a3-40b4-82c2-b1ce7b965488 for instance d4e823ff-de17-4756-8990-8c2cdc9bd349 on hv-cinder-80403 Jan 28 08:06:37.056410 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-5578c065-464e-4088-88b9-f08341024a87 req-f6cdef25-73f1-4255-b6d4-9be9d287236d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031929 Jan 28 08:06:37.057016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 25/50] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:37.291407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:37.292112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:37.298974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.299497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.300361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.300797 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.390611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:37.401038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:37.401800 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:37.402225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:37.402642 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:37.423587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.424265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.425316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.426645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.448685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:37.450034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:37.462299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:37.464689 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:37.486441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:37.494605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-da19ec2a-2ec8-405c-be9a-17847f3c55ef tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.207315 Jan 28 08:06:37.495293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:37 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:37.638734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:37.645458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:37.645861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e106f9c3-53cc-4fb1-85eb-efd8435db817 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.693856 Jan 28 08:06:37.647102 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 26/52] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jan 28 08:06:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 08:06:37.658001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.658630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.660171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.660752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.667881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:37.668874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:37.753661 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:37.776756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:37.778298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:37.779441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-901e03e4-62f4-4a54-b709-993a4630d389 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1281 microversion: 2.20 time: 0.116891 Jan 28 08:06:37.790734 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 27/53] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:37 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:37.846502 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:37.860149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ac8cf732-7a43-4de3-8f7a-d78518d06e1a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.234916 Jan 28 08:06:37.861165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:37 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:37.960674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:37.961495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:37.971355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.971739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:37.972590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:37.973197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:38.147471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:38.154745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-05c1e334-a2c9-4e1f-81ba-c5660e2a4699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.197647 Jan 28 08:06:38.155580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 28/55] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:37 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:38.513269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:38.514961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:38.524198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:38.525095 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:38.526262 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:38.526907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:38.672132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1542287458", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5631824c-d1c4-4260-a605-4dc536d16870"}], "security_groups": [{"name": "tempest-securitygroup--1705754564"}], "key_name": "tempest-keypair-1554948144", "user_data": "}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:38.854880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:38.863233 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] validate_networks() for [('5631824c-d1c4-4260-a605-4dc536d16870', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:06:38.865473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-16483478-94dd-48d3-bb16-625c6f062d46 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.357231 Jan 28 08:06:38.866644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 28/56] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:38 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:38.871493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:38.872252 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:38.961258 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:38.970805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:38.975929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:38.978870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0e632a21-a8cb-4e67-a199-6769b28fc9b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1281 microversion: 2.20 time: 0.110966 Jan 28 08:06:38.980184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:38 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:38.993384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:38.996907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:39.037254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.037780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.038770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.039328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.282029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:39.295545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-710fa029-964f-4054-aaf3-ae48b95c9136 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.313358 Jan 28 08:06:39.296552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 30/58] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:38 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:39.306302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:39.308096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:39.314390 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.316616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.317596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.318185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.553612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:06:39.554869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:06:39.555718 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:06:39.559072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:06:39.559072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:06:39.587555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.588006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.590586 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.592726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.593331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:39.611357 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9f3b372d-3ee4-4df3-bd9a-efddefe1aa42 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.312021 Jan 28 08:06:39.613270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:39 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:39.613934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:06:39.618520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:06:39.633267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:06:39.635527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:06:39.820993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a477b4da-0285-456a-83fb-635046f66c8a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.155226 Jan 28 08:06:39.821721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 29/60] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:06:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:06:39.831689 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7f4f0e3b-473d-46b3-8384-0265e176028e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:39.832304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7f4f0e3b-473d-46b3-8384-0265e176028e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:39.889449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:39.890088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:39.894655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7f4f0e3b-473d-46b3-8384-0265e176028e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:39.901211 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.901681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.902472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:39.902906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:39.913334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7f4f0e3b-473d-46b3-8384-0265e176028e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1238 microversion: 2.1 time: 0.085175 Jan 28 08:06:39.923169 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 32/61] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:39 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:39.997345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:39.998167 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:40.008734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.009290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.014432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.015344 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.098661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.106450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.108027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.108814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.109123 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d4f09b2a-2da7-464d-b377-5325481340c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1277 microversion: 2.20 time: 0.115880 Jan 28 08:06:40.109686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 33/62] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:39 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:40.116385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d1a838ea-354c-44cb-8a9c-c3e4ebd190d4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.238420 Jan 28 08:06:40.117056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:39 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:40.312759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:40.313395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:40.319406 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.319860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.320705 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.327160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.461528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.469018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-05fa4180-a3de-4d3c-88e5-7417de710b14 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.159953 Jan 28 08:06:40.469592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 34/64] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:40 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:40.629044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:40.630743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:40.635468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.635934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.636716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:40.637145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:40.792160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:40.800504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f2d4f47a-2dcd-4ee8-b291-38e68637f52b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.175464 Jan 28 08:06:40.803322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 31/65] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:40 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:40.930898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d583bc18-b24a-43bb-b55d-84e40926e740 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:40.931587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d583bc18-b24a-43bb-b55d-84e40926e740 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:41.011062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d583bc18-b24a-43bb-b55d-84e40926e740 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.020437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d583bc18-b24a-43bb-b55d-84e40926e740 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1238 microversion: 2.1 time: 0.093652 Jan 28 08:06:41.028808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:40 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:41.127578 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:41.128270 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:41.132315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:41.133146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:41.134759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.135303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.136235 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.136737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.139673 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.143879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.143879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.143879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.197764 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.208545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.223993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.223993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2f990ead-338d-48a8-ac0a-931bdb628f71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1341 microversion: 2.20 time: 0.087695 Jan 28 08:06:41.223993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 32/67] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:41 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:41.333261 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.340666 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e03f3a01-1e00-4d77-a349-f9e91cece792 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.212336 Jan 28 08:06:41.341271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 36/68] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:41 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:41.485828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:41.486679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:41.493961 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.494585 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.495393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.495823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.640422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:41.648355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-90075632-3180-4ed0-a5b1-dcfd40f193df tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.166150 Jan 28 08:06:41.648935 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:41 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:41.816640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:41.817680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:41.823749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.824197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:41.825065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:41.825647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.034153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.038710 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:42.039729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:42.044112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-80167790-6360-48b9-ab1c-b88d3df2698f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.229275 Jan 28 08:06:42.053962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 37/70] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:41 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:42.084494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.085055 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.085819 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.086260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.164931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.173944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d6c5d0e9-053f-4317-a314-786c5baccb26 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1290 microversion: 2.1 time: 0.140215 Jan 28 08:06:42.174968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 34/71] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:42 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:42.241492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:42.242207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:42.251232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.251799 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.253222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.255421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.357173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:42.357977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:42.364414 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.364859 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.365723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.366151 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.501153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.508735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-17c94316-c91a-4d69-9c18-f9f69affacc4 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.155113 Jan 28 08:06:42.509311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 35/72] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:42 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:42.537596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.545791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.547340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.548435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f02d2219-fe2c-4c2f-a91b-484e9e3a8a33 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.312358 Jan 28 08:06:42.548998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 38/73] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:42 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:42.665149 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:42.665766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:42.671713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.672161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.672930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:42.673360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:42.822097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:42.832428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a9235120-ce18-45b9-96d2-92f1fedf1216 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.170820 Jan 28 08:06:42.833479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 36/74] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:42 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:43.061074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:43.061775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:43.067926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.068374 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.069147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.069583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.193287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:43.194842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:43.205186 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.206011 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.207908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.208703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.327176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.336006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4e4b24f5-fd60-4c29-82b4-8913949a2920 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.278467 Jan 28 08:06:43.338579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:43 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:43.386347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.398719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-012ff335-368e-46fd-9c33-f8dd5233179f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1290 microversion: 2.1 time: 0.210686 Jan 28 08:06:43.408420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 37/76] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:43 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1290 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:43.525937 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:43.526685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:43.533002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.533524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.535038 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.535564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.567914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:43.578339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:43.578339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.578339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.578339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.579716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.828914 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.841853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.852269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c8ecdf14-8bf0-4284-bc30-1fce7baad09c tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.330024 Jan 28 08:06:43.861529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 40/77] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:43 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:43.861712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.861712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:43.861712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-83f3ea58-8205-4792-8e4d-77a88905fd70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.293788 Jan 28 08:06:43.862018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-15b8061c-08c6-4509-a917-b13d328d758b req-3e00847c-ef7d-42a7-a8fc-ca07de88b472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:43.868343 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 38/78] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:43 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:43.872574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:43.872574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:06:43.876091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:43.877303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:43.887075 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.887757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.890230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.890649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-15b8061c-08c6-4509-a917-b13d328d758b req-3e00847c-ef7d-42a7-a8fc-ca07de88b472 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:43.890859 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.891094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-15b8061c-08c6-4509-a917-b13d328d758b req-3e00847c-ef7d-42a7-a8fc-ca07de88b472 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:43.912943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-15b8061c-08c6-4509-a917-b13d328d758b req-3e00847c-ef7d-42a7-a8fc-ca07de88b472 service nova] Creating event network-changed:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:06:43.921840 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-15b8061c-08c6-4509-a917-b13d328d758b req-3e00847c-ef7d-42a7-a8fc-ca07de88b472 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067308 Jan 28 08:06:43.922435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 41/79] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:44.146761 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:44.154269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0e45e712-fe28-4b38-936e-6b5e0c1f7e5c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.283930 Jan 28 08:06:44.154840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:43 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:44.354425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:44.355120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:44.361114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.361554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.362900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.363352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.415823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:44.416387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:44.423537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.424190 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.425546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.425990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.494869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:44.497170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:44.502389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f581fe96-de9c-4762-8cca-9d70676af100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1296 microversion: 2.1 time: 0.090314 Jan 28 08:06:44.503016 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:44 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:44.504395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dcc593fb-2839-47a9-a127-ead46a8e4068 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.154124 Jan 28 08:06:44.509793 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:44 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:44.870179 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:44.871342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:44.873917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:44.874527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:44.878081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.878784 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.879891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.880522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.880966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.881294 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:44.881731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:44.882161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.025735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.039435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-05e57f00-8676-4789-a370-4d9452f26e1b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.173571 Jan 28 08:06:45.052554 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:44 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:45.054950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.063169 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.064701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.066812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-12477fa4-65ef-4851-b782-b99d8d70acc9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.196562 Jan 28 08:06:45.067552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 43/84] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:44 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:06:45.170666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:45.171292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:45.177618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.178061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.178820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.179268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.306789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.314049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1fc33ba8-5417-490b-974d-f3389b6a8ee7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.147266 Jan 28 08:06:45.314617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:45 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:45.524362 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:45.524845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:45.525250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:45.525409 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:45.531037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.531298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.531535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.531991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.532336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.532767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.532874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:45.533249 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:45.661936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.664232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:45.670076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1631432c-a70c-4f7c-aefe-82092d873f61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.148751 Jan 28 08:06:45.670664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:45 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:45.678492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-580b6ee2-0b4d-42e6-8a1c-858e7d6110df tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.151795 Jan 28 08:06:45.678492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 44/87] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:45 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:46.059759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:46.063672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:46.066947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.067886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.068259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.068592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.089952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:46.090983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:46.098283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.109579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.109579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.109579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.237901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.246072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.247857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.248949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cd9a9ab5-dd84-4ece-b878-68803786f497 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.163787 Jan 28 08:06:46.249907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 45/88] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:46 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:46.276447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.283894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-21b10ad1-88f3-42a0-9068-6bd26e2502a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.227764 Jan 28 08:06:46.284569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:46 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:46.338123 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:46.339276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:46.346307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.346959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.347991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.348473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.482212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.490702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-30986fde-5f7b-4fc3-b282-ebe340353a62 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.159274 Jan 28 08:06:46.491319 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:46 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:46.688932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:46.689551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:46.701968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:46.701968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:46.702488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.702488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.702488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.702488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.702774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.702774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.702774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:46.702774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:46.841398 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.856430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1fb36c3f-fef6-405d-b39e-b116d32cf29a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.168938 Jan 28 08:06:46.858183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 47/91] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:46 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:46.895575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:46.903588 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cd1f4eb6-b1cc-4672-a8d9-187684b043f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.218278 Jan 28 08:06:46.904265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 45/92] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:46 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:47.122491 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-4255f281-c469-44bb-80f1-c16f96ca27e6 req-cf14efd5-c82b-4059-91fc-0d89b1ac2677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab426f8-a759-4d28-b87b-c5a029df5761", "tag": "475d6a57-bcb8-44c5-b348-83a41470900b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:47.124213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:47.124213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:06:47.131274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4255f281-c469-44bb-80f1-c16f96ca27e6 req-cf14efd5-c82b-4059-91fc-0d89b1ac2677 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.131737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4255f281-c469-44bb-80f1-c16f96ca27e6 req-cf14efd5-c82b-4059-91fc-0d89b1ac2677 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.143839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-4255f281-c469-44bb-80f1-c16f96ca27e6 req-cf14efd5-c82b-4059-91fc-0d89b1ac2677 service nova] Creating event network-changed:475d6a57-bcb8-44c5-b348-83a41470900b for instance 7ab426f8-a759-4d28-b87b-c5a029df5761 on hv-cinder-80403 Jan 28 08:06:47.148837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-4255f281-c469-44bb-80f1-c16f96ca27e6 req-cf14efd5-c82b-4059-91fc-0d89b1ac2677 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030484 Jan 28 08:06:47.149627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 48/93] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:47.267904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:47.274668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:47.275999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.276510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.277410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.277895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.302509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:47.303316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:47.313258 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.313742 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.314774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.315681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.453665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:47.464536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:47.466153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:47.467434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8169bdde-f8da-4987-a996-7fbbea959fa4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.203326 Jan 28 08:06:47.468089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 46/94] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:47 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:47.508273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:47.509011 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:47.514703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.515193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.515998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.516460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.539976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:47.548866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-02723639-ea29-4691-8207-4649a0df0925 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.251090 Jan 28 08:06:47.549450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 49/95] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:47 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:47.649686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:47.656862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-41cc215d-b240-438f-80a9-a644d456cecd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.152483 Jan 28 08:06:47.657424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 47/96] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:47 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:47.873456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:47.874068 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:47.880357 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.880815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.881610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.882080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.920813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:47.921791 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:47.932932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.932932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:47.932932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:47.932932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.037420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.045747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6ff74323-a5df-4aee-9502-eb9fa95c728c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.175885 Jan 28 08:06:48.046623 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 50/97] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:47 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:48.125095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.132419 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-13069972-e1e2-42b6-90a4-959db911cf52 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.216173 Jan 28 08:06:48.132984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 48/98] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:47 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:48.486596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:48.491935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:48.497335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.497973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.498770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.499205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.575839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:48.581468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:48.598248 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.599034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.600785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.602587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.744414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.755469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.756187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.757298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6a65a0db-7365-4c5a-81a0-4a41d3cdb6bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.275066 Jan 28 08:06:48.758311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 51/99] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:48 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:48.763704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:48.764464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:48.771086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.771874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.772852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:48.773477 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:48.858082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.866237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3e10866a-3a1f-4484-9989-46e1834678ee tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.303288 Jan 28 08:06:48.868732 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 49/100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:48 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:48.929999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:48.937863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d25410a9-cc2a-435c-8fa0-89cf94f37beb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.178411 Jan 28 08:06:48.938619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:48 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:49.064206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:49.064821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:49.072650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.073099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.073885 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.074473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.148836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:49.149959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:49.156554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.157204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.158186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.159590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.220061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:49.227828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a97b2e2b-770d-44f2-ae6b-2b5a595dda5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.167079 Jan 28 08:06:49.228826 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:49 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:49.301217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:49.308905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e7908362-7628-4953-934b-74068a89ce74 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.163611 Jan 28 08:06:49.309477 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 53/103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:49 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:49.776225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:49.776836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:49.782608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.783066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.784361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.784978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.883923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:49.884566 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:49.890523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.890971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.891878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.892312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.915674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:49.922622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:49.924175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:49.925323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0cbb989c-ca8a-4c76-991a-60f5b50ae701 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.152723 Jan 28 08:06:49.925886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 51/104] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:49 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:49.955171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:49.956420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:49.962223 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.962668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:49.963492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:49.963920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.065479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:50.073026 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-32893af6-b891-48c4-a599-b85e3b980221 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.193027 Jan 28 08:06:50.073598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 54/105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:49 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:50.123735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:50.131126 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bc0e71c0-0c0a-494f-9754-79c1368fdff3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.179572 Jan 28 08:06:50.131803 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 52/106] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:49 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:50.245382 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:50.246157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:50.252097 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.253093 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.253869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.254343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.327827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:50.328445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:50.335985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.336947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.338204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.339622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.412821 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:50.420408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-df81ca0a-be5e-48f4-85b2-965a5e680239 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.178861 Jan 28 08:06:50.421361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 55/107] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:50 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:50.475851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:50.483099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-931322d9-5b2f-4f40-92ba-70f2bfba6337 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.158949 Jan 28 08:06:50.483696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 53/108] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:50 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:50.942273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:50.942910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:50.948875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.949330 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:50.950092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:50.950527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.081587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.089516 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:51.089906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.090131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:51.091505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.092775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a373823a-ee01-4feb-b1ac-981a11d8821f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.154239 Jan 28 08:06:51.093414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 56/109] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:50 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:51.096020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.096445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.097222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.097654 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.148192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:51.148964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:51.154825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.155309 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.156094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.156530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.275779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.282925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ca08af86-b9be-4707-a677-f31692fc7807 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.196972 Jan 28 08:06:51.283535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 54/110] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:51 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:51.352813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.360226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d2db6257-6990-484e-8cbc-ab4b0d3eb801 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.215815 Jan 28 08:06:51.360804 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 57/111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:51 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:51.436612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:51.437281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:51.443119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.443606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.444415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.444814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.501080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:51.501729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:51.508700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.509523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.510313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:51.510750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:51.581425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.588652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-370b5002-7c4b-4811-aa1d-9730d7fc17f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.155701 Jan 28 08:06:51.589318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 55/112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:51 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:51.645746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:51.653117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-08223bdf-b95a-4524-95dd-3f3e7b3b352e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.157171 Jan 28 08:06:51.653688 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 58/113] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:51 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:52.110723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:52.111365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:52.117479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.117861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.118635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.119074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.257930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.265846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.267416 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.269017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-28052152-829b-4176-bfc6-350b4224764a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.162002 Jan 28 08:06:52.269576 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 56/114] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:52 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:52.299375 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:52.300108 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:52.308126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.308126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.308126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.308126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.379093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:52.380335 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:52.386458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.387209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.388374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.388963 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.458327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.465481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7bae40d1-d49e-457a-a692-e2d1b9ed7050 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.169920 Jan 28 08:06:52.466049 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 59/115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:52 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:52.532759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.540658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ccd713f6-f1b7-42db-8707-f72ea4ca29b1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.165226 Jan 28 08:06:52.541227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 57/116] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:52 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:52.605295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:52.605905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:52.611952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.612426 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.613407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.613867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.672686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:52.672686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:52.689678 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.690620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.691500 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:52.691927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:52.796280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.809761 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7460a120-098b-48c0-b6c1-1180c4dcafd5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.207650 Jan 28 08:06:52.811143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 60/117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:52 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:52.850000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:52.858392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-051f5ce7-ef96-4429-9e50-8512fda2093e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.192267 Jan 28 08:06:52.858962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 58/118] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:52 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:53.287939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:53.288548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:53.294642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.295087 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.295882 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.296315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.428765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.436452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.437983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.439071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-67a98219-d48a-4097-8272-c8f856ebec70 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.155365 Jan 28 08:06:53.439664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 61/119] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:53 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:53.482860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:53.483500 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:53.489729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.490306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.491078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.491532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.557223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:53.558010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:53.563983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.564434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.565701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.566131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.622511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.630457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-737fbddb-5433-488f-bf81-b127babbebdf tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.151232 Jan 28 08:06:53.631031 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 59/120] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:53 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:53.700550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.713056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-479cca56-8ecc-40b0-83cd-099088d9c172 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.159069 Jan 28 08:06:53.717449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 62/121] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:53 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:53.829142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:53.829750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:53.835431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.835874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.836636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.837069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.874758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:53.875540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:53.882245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.882810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.883768 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:53.884297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:53.967357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:53.974836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-925e5d5d-3a80-4e84-8c92-06c8e91d138d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.149276 Jan 28 08:06:53.975535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 60/122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:53 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:54.013504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.020776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1b547d78-2591-462c-97ba-9ed20c7828e5 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.149571 Jan 28 08:06:54.021345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 63/123] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:53 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:54.457834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:54.458444 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:54.464483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.464934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.465706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.466143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.606839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.616226 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.617875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.619010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-708edf3e-00cc-40b7-9d88-182c7e7980c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.165519 Jan 28 08:06:54.619688 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 61/124] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:54 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:54.647029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:54.647701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:54.653567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.654010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.654771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.655200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.733401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:54.734084 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:54.740898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.741345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.742115 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.742542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.786458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.797295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f9215083-06e0-4a3c-b6e0-239fd5988de3 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.153617 Jan 28 08:06:54.798383 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 64/125] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:54 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:54.879558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:54.886721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a96c8940-89bf-4c5d-b36f-a92f307ed6c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.157110 Jan 28 08:06:54.887296 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 62/126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:54 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:54.991933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:54.992544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:54.998328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:54.998778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:54.999586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.000111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.037432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:55.037970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:55.044332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.044834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.045611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.046046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.129326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:55.137067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2ef8501a-1e5a-4cd2-a60b-4aac2a71f0ba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.148806 Jan 28 08:06:55.137638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 65/127] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:54 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:55.183844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:55.191145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-df254c4c-67cb-46ed-b778-19ab492db35f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.157964 Jan 28 08:06:55.191739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 63/128] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:55 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:55.636956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:55.637564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:55.643420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.643876 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.644648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.645136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.779747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:55.787947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:55.789462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:55.790552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-56ce7a66-5c5e-467f-bd87-78378ca8a72f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.157364 Jan 28 08:06:55.791103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 66/129] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:55 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:55.816347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:55.817093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:55.826072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.826072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.826072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.826072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.905027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:55.905638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:55.911847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.912287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.913063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:55.913490 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:55.999847 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.007864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-eda7df78-585a-40a4-8f8d-7f70396e84ea tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.196509 Jan 28 08:06:56.017402 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 64/130] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:55 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:56.064807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.072864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7b2b2c1f-4490-430f-ab82-84b7b26c63a2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.172876 Jan 28 08:06:56.073434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 67/131] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:55 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:56.153411 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:56.154020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:56.160052 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.161066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.161275 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.161709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.204380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-2ba859f6-ab26-423c-a9b5-32d6c7a8d88c req-bb95169d-b60d-48c3-a3c3-4b855034f7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c754703c-7e85-477c-a969-1c629a198cd3", "name": "network-vif-plugged", "status": "completed", "tag": "7c16c6b5-0b52-4684-817d-70da66045d63"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:56.206234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:56.206234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:06:56.213551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-2ba859f6-ab26-423c-a9b5-32d6c7a8d88c req-bb95169d-b60d-48c3-a3c3-4b855034f7d0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.214006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-2ba859f6-ab26-423c-a9b5-32d6c7a8d88c req-bb95169d-b60d-48c3-a3c3-4b855034f7d0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.226004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-2ba859f6-ab26-423c-a9b5-32d6c7a8d88c req-bb95169d-b60d-48c3-a3c3-4b855034f7d0 service nova] Creating event network-vif-plugged:7c16c6b5-0b52-4684-817d-70da66045d63 for instance c754703c-7e85-477c-a969-1c629a198cd3 on hv-cinder-80403 Jan 28 08:06:56.250555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-2ba859f6-ab26-423c-a9b5-32d6c7a8d88c req-bb95169d-b60d-48c3-a3c3-4b855034f7d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101802 Jan 28 08:06:56.251556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 65/132] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:56.257303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:56.262274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:56.265480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.274451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.275532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.276596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.324891 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.332884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1eab501f-5b3e-4d44-ad31-9bfcd56f4750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.182953 Jan 28 08:06:56.333459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 68/133] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:56 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:56.431027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.438467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b8c1f56d-86d7-409e-a933-6f4b14af785c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.185788 Jan 28 08:06:56.439044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 66/134] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:56 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:56.809299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:56.809913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:56.816132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.816584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.817585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:56.818170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:56.957386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.965461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.967012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:56.968127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4732dda5-011e-4c36-a7e1-99f0bee0be1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.163058 Jan 28 08:06:56.979813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 69/135] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:56 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:57.023791 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:57.024400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:57.030276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.030723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.031533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.031968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.089661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:57.090302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:57.096389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.096842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.097674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.098101 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.170369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:57.177873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-797b37db-c336-4448-8157-df82bf32ad10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.157718 Jan 28 08:06:57.178450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:57 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:57.226305 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:57.233466 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-330b29e7-2ea3-4f66-96ee-73c229213693 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.147720 Jan 28 08:06:57.238103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:57 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:57.349838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:57.350487 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:57.356620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.357079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.357849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.358271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.455640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:57.456251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:57.462215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.462715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.463527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.464018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.484555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:57.492473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3cdb5322-8061-45ab-98f3-ae003b1dbcbf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.146357 Jan 28 08:06:57.493046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 68/138] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:57 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:57.595433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:57.609902 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c4c28c66-b8ed-4481-9552-cad13dc8dff8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.153260 Jan 28 08:06:57.609902 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:57 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:57.986022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:57.986744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:57.993544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.994168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:57.994938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:57.995318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.195261 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:58.196735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:58.210451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.211185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.213137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.213749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.322960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.331427 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.333283 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.334327 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0e2cc47e-b922-47c7-8ca2-1570c3067a4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.352313 Jan 28 08:06:58.335205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 69/140] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:57 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:58.340829 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:58.341668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:58.348900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.349577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.350372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.350811 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.379296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.386997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d86c4fd0-78d6-4af5-8aa8-c08416132166 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.195710 Jan 28 08:06:58.389904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 72/141] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:58 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:58.392455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0612c4-618b-450a-a6dc-bd226fcde646", "name": "network-vif-plugged", "status": "completed", "tag": "1758b189-1edc-4faa-9a0d-821aa50b7283"}, {"server_uuid": "d4e823ff-de17-4756-8990-8c2cdc9bd349", "name": "network-vif-plugged", "status": "completed", "tag": "e58b3f10-73a3-40b4-82c2-b1ce7b965488"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:06:58.394811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:06:58.394811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:06:58.402311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.402820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.416230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] Creating event network-vif-plugged:1758b189-1edc-4faa-9a0d-821aa50b7283 for instance cc0612c4-618b-450a-a6dc-bd226fcde646 on hv-cinder-80403 Jan 28 08:06:58.424739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] Creating event network-vif-plugged:e58b3f10-73a3-40b4-82c2-b1ce7b965488 for instance d4e823ff-de17-4756-8990-8c2cdc9bd349 on hv-cinder-80403 Jan 28 08:06:58.424739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-3ae7ce19-6c2d-4827-a117-f110fc06ad88 req-fd47bd27-e170-4b54-8a0c-99009bdc2832 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034889 Jan 28 08:06:58.424739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 73/142] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:06:58.497044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.511211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:58.512294 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:58.517744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f49c3d77-92ea-45f5-ba07-bf37a3d9fa93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.181402 Jan 28 08:06:58.526995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:58 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:58.527127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.527127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.527127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.527127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.622815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:58.623946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:58.635779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.641558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.641558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:58.641558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:58.676272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.684494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-821ce95f-dcff-4a8f-96ea-6053962ae0fd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.178496 Jan 28 08:06:58.686863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 74/144] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:58 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:58.791417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:58.801080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fcf86285-4bb6-4e8c-aad9-84794cc75794 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.183010 Jan 28 08:06:58.802257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:58 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:59.352407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:59.353014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:59.363077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.363077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.363077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.363077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.403172 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:59.408433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:59.409638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.410077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.410842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.411285 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.494321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.507304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.508828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.509966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0eb58614-73d2-4e82-a4f8-6f5d9be47ebf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.161543 Jan 28 08:06:59.510538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 75/146] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:06:59 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:06:59.534985 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:59.535860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:59.542548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.542999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.543844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.544278 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.554908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.562818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ffc10952-e2d8-46f6-83b9-3bf3e0100cb7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1314 microversion: 2.1 time: 0.163192 Jan 28 08:06:59.563806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 72/147] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:59 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:59.678521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.685770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8edded8d-ecae-4371-b190-ee6c015e0110 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.154491 Jan 28 08:06:59.686436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:59 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:06:59.702690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:59.703344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:59.709129 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.709582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.710358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.710796 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.821539 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:06:59.822897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:06:59.829613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.830191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.831909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:06:59.832414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:06:59.851898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.859134 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-258ce20f-1a59-44b1-8743-b9a7b1f09d13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.160017 Jan 28 08:06:59.859734 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 73/149] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:59 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:06:59.958766 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:06:59.966044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-25d2cce9-5be8-400e-a297-83ff2c56cb3f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.148111 Jan 28 08:06:59.969063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:06:59 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:00.449656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-dee1aaf8-9f6e-4cf5-a910-3bddd8d60f5b req-980023e7-2629-4b87-a9c6-9405f4619c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f4c98-79fa-43de-9457-1e3b5bc6e93c", "name": "network-vif-plugged", "status": "completed", "tag": "795f771c-454b-4288-b77b-9f274f0cb6d5"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:00.451365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:00.451365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:07:00.459060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-dee1aaf8-9f6e-4cf5-a910-3bddd8d60f5b req-980023e7-2629-4b87-a9c6-9405f4619c17 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.459538 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-dee1aaf8-9f6e-4cf5-a910-3bddd8d60f5b req-980023e7-2629-4b87-a9c6-9405f4619c17 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.470657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-dee1aaf8-9f6e-4cf5-a910-3bddd8d60f5b req-980023e7-2629-4b87-a9c6-9405f4619c17 service nova] Creating event network-vif-plugged:795f771c-454b-4288-b77b-9f274f0cb6d5 for instance 449f4c98-79fa-43de-9457-1e3b5bc6e93c on hv-cinder-80403 Jan 28 08:07:00.476247 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-dee1aaf8-9f6e-4cf5-a910-3bddd8d60f5b req-980023e7-2629-4b87-a9c6-9405f4619c17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Jan 28 08:07:00.477204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 74/151] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:00.527730 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:00.528326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:00.539556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.540071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.540927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.541469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.581485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:00.582243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:00.589007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.589535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.590388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.590894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.706283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:00.714778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:00.716606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:00.718086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-63c5d453-ced3-475e-a658-614f2cf81c4f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.193934 Jan 28 08:07:00.718915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 78/152] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:00 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:00.726096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:00.732270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:00.732938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:00.739883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.740334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.741110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.741541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.757858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-01c18d68-f73b-48dd-a466-656d184be498 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1502 microversion: 2.1 time: 0.180792 Jan 28 08:07:00.770581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 75/153] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:00 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:00.879844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:00.880590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:00.891169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.892876 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:00.895312 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:00.895858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:01.070131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.079143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a3b522d9-ea85-4a74-97ab-1e13eb15cbd1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.205772 Jan 28 08:07:01.080058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 76/154] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:00 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:01.085030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:01.085954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:01.091789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:01.092542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:01.093355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:01.093952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:01.129146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.136343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-04955a11-fd79-4b45-b22b-67e38eca6434 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1316 microversion: 2.1 time: 0.416428 Jan 28 08:07:01.137856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 79/155] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:00 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:01.293024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.301371 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-dcc30d4b-11ec-4f4d-8c10-8f1ee5e57f03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.220146 Jan 28 08:07:01.302618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 77/156] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:01 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:01.736312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:01.737516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:01.743846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:01.744301 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:01.745078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:01.745512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:01.886048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.895877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.897700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:01.898971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6aa54421-9777-4727-aac8-a84e8e5b7c71 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.166950 Jan 28 08:07:01.899563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 80/157] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:01 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:02.095906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:02.097119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:02.102994 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.103508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.104307 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.104762 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.153957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:02.154607 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:02.163081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.163556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.164497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.164925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.260251 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:02.267782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c0eff05e-5f44-4fef-be83-beb49c554aaf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.175556 Jan 28 08:07:02.268925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 78/158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:02 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:02.305161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:02.314058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-92ba00e2-443c-41a0-923c-35837fac92bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1507 microversion: 2.1 time: 0.163278 Jan 28 08:07:02.318349 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 81/159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:02 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:02.328777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:02.330215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:02.337159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.342828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.342828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.342828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.489619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:02.498473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2ad757f9-f93c-44a1-a212-d6933f444248 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1321 microversion: 2.1 time: 0.178200 Jan 28 08:07:02.499006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "name": "network-vif-plugged", "status": "completed", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}, {"server_uuid": "7ab426f8-a759-4d28-b87b-c5a029df5761", "name": "network-vif-plugged", "status": "completed", "tag": "475d6a57-bcb8-44c5-b348-83a41470900b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:02.500774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:02.500774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:07:02.503490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 79/160] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:02 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:02.508595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.509033 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.521057 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] Creating event network-vif-plugged:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:07:02.521566 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] Creating event network-vif-plugged:475d6a57-bcb8-44c5-b348-83a41470900b for instance 7ab426f8-a759-4d28-b87b-c5a029df5761 on hv-cinder-80403 Jan 28 08:07:02.528056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-4d5518a0-0e97-4715-991a-805a4acdc94f req-98264164-365d-4a7a-8405-4667d2fc423a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032563 Jan 28 08:07:02.528713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 82/161] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:02.796046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b7c1e6d-6cff-41ed-b3fa-b6d9ebf167d6"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:02.797835 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:02.804995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.805439 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.806416 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.806939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.918851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:02.919583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:02.925728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.926171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:02.927099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:02.927557 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.127022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:03.135632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:03.137216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:03.143590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b33a8f5b-ed92-4e45-8ff6-fedf48e775d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.224097 Jan 28 08:07:03.143590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 83/162] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:02 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:03.286084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:03.286798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:03.293004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.293486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.294259 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.294900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.438267 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:03.445920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f840a565-31d5-4bbc-a2b7-b97df8ebcb3e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.164435 Jan 28 08:07:03.447479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:03 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:03.513990 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:03.514579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:03.520774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.521215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.521973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.522399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.659689 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:03.667629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ec84851a-db70-463a-88f1-aa8678ad82ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1514 microversion: 2.1 time: 0.156842 Jan 28 08:07:03.668207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 85/164] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:03 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:03.688991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:03.690025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:03.696283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.696731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.697504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:03.697935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:03.762170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'flavor' on Instance uuid 449f4c98-79fa-43de-9457-1e3b5bc6e93c {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:07:04.154852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cefaf58c-fa1e-44c3-9945-65fdb8a3bd98 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c/action" status: 200 len: 32 microversion: 2.1 time: 0.469825 Jan 28 08:07:04.155477 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 86/165] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:03 2022] POST /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c/action => generated 32 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 08:07:04.161049 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:04.161733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:04.167958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.168405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.169165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.169597 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.299164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:04.308463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:04.310243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:04.311485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a17d7a21-8543-4b1f-b141-013fb22607d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.154818 Jan 28 08:07:04.312617 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 87/166] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:04 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:04.329113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:04.330978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:04.338246 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.338827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.339914 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.340666 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.478167 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:04.485644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-602aea2f-442e-432d-abc2-1e43204ac4ff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.171559 Jan 28 08:07:04.486214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 88/167] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:04 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:04.490906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:04.491532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:04.497075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.497463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.498234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:04.498666 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:04.627755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:04.634927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1110aad2-6a62-4d6e-afbc-08c88903d05d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.147272 Jan 28 08:07:04.635526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 89/168] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:04 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:05.329540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:05.330159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:05.336631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.337077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.341026 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.341026 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.477568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:05.485376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:05.490590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:05.490590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b6cf2fff-8bc8-4320-8389-d655b6c941fd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.162803 Jan 28 08:07:05.490590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 90/169] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:05 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:05.502366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:05.502961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:05.508565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.509008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.509773 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.510210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.641906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:05.649558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f7378df4-23e5-46e7-bda6-7ce60db760bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.150568 Jan 28 08:07:05.650129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 91/170] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:05 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:05.654612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:05.655524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:05.662786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.663337 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.664405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:05.664907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:05.800734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:05.808461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-32dab820-250f-4c35-a5af-6f2885862259 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.157064 Jan 28 08:07:05.809339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 92/171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:05 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:06.506612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:06.507215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:06.513007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.513457 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:06.514225 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.514651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:06.715618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:06.722121 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:06.723737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:06.724912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-03010457-eec5-4c53-99d3-c8fccbabeed6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.222609 Jan 28 08:07:06.725453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 93/172] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:06 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:07:06.729534 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:06.730120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:06.735485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.735930 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:06.737196 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.737628 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:06.865426 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:06.872698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ed08b72a-ce5d-4325-a16f-3a75b8ad2181 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.146318 Jan 28 08:07:06.873263 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 94/173] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:06 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:06.877397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:06.877989 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:06.883378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.883832 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:06.884590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:06.885089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:07.024493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:07.031780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-19f64248-bbb5-42c7-8b51-238ac3b01a56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.157586 Jan 28 08:07:07.032369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 95/174] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:06 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:07.742159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:07.742826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:07.749312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:07.749759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:07.750536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:07.750966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.054373 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:08.063453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:08.065690 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:08.067000 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f81986b2-6805-4a3b-99fe-78963882b376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.328405 Jan 28 08:07:08.067753 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 96/175] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:07 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:07:08.082092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:08.082092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:08.082092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.082092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.082594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.082594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.327159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:08.334313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9ca4773b-c91c-4842-953e-74429562acb6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.265545 Jan 28 08:07:08.334864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 97/176] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:08 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:08.339654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:08.339799 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:08.356290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.356843 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.357664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.358103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.496073 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:08.503785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1a42fb4b-94f6-4ebc-b672-b2bb633a0436 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1364 microversion: 2.1 time: 0.167935 Jan 28 08:07:08.504355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 98/177] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:08 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:08.551967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3d38647-0824-4674-8ecf-0927e41c0322"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:08.553070 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:08.559124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.559590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.563080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:08.566311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:08.578696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-01ff64bb-0260-47cf-a57f-699379b59f10 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "POST /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.785858 Jan 28 08:07:08.580363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 80/178] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:07:02 2022] POST /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3/os-volume_attachments => generated 194 bytes in 5789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:09.090535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:09.091278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:09.115608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.116071 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.116876 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.117316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.312975 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:09.322319 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:09.324208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:09.325565 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1bf1a43b-8b00-4ffe-ab54-c3c26a1ad8f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1406 microversion: 2.20 time: 0.239598 Jan 28 08:07:09.337094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 81/179] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:09 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:09.361082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:09.361082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:09.366633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.367369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.368374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.369018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.510503 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:09.519488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ec9c525d-fd99-4a23-a79a-c492923fbd49 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.165267 Jan 28 08:07:09.520096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 82/180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:09 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:09.525013 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:09.525761 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:09.531814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.532262 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.533103 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.533606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.671159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:09.680558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-de06fba1-bb02-4d1e-93f6-0220307dd269 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1548 microversion: 2.1 time: 0.158894 Jan 28 08:07:09.681128 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 83/181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:09 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:09.697858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:09.698428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:09.704472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.704989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.707218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:09.707848 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:09.796193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6b180173-c733-429b-a93e-eff63660e394 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102048 Jan 28 08:07:09.796780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 84/182] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jan 28 08:07:09 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:09.834694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e5d26488-282f-4e2d-9934-c692ca23c067 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.286376 Jan 28 08:07:09.840133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 99/183] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:07:08 2022] POST /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments => generated 194 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:10.344841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:10.345450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:10.351289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.351749 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.352533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.352970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.537208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:10.537896 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:10.544725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.545484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.546944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.547624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.632057 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:10.640639 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:10.643733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:10.645336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-adc0e639-0834-46a5-aae0-12b2e7f0cb56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1598 microversion: 2.20 time: 0.304734 Jan 28 08:07:10.647203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 85/184] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:07:10 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:10.666002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:10.666776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:10.673787 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.674684 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.675193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:10.675646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:10.715604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:10.723327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2b7c26cd-c94c-4ddc-9192-dd15a73d7ed6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.190466 Jan 28 08:07:10.724045 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 100/185] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:10 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:10.831892 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c0166e06-b0ab-4ae2-8f31-9a17d1aba387 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.169399 Jan 28 08:07:10.832518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 86/186] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jan 28 08:07:10 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:11.740807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:11.741673 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:11.748036 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:11.748561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:11.749403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:11.750355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:11.823204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:11.824225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:11.840169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:11.840611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:11.852083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:11.852766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:11.938592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:11.951145 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1fb4566d-2b8d-4bbf-bd48-962e37daa5d9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.214559 Jan 28 08:07:11.953596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 101/187] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:11 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:11.954939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3a0bc3ab-57a4-474c-9283-cdf18a588a48 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.134972 Jan 28 08:07:11.959565 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 87/188] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:11 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 08:07:11.969878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-44d8e7a5-9a16-44a6-a339-62c14db383d6 req-853abdd1-0433-4280-b7a9-a0cb84c221d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab426f8-a759-4d28-b87b-c5a029df5761", "tag": "475d6a57-bcb8-44c5-b348-83a41470900b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:11.971674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:11.971674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:07:11.980062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-44d8e7a5-9a16-44a6-a339-62c14db383d6 req-853abdd1-0433-4280-b7a9-a0cb84c221d5 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:11.980916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-44d8e7a5-9a16-44a6-a339-62c14db383d6 req-853abdd1-0433-4280-b7a9-a0cb84c221d5 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:11.993344 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-44d8e7a5-9a16-44a6-a339-62c14db383d6 req-853abdd1-0433-4280-b7a9-a0cb84c221d5 service nova] Creating event network-changed:475d6a57-bcb8-44c5-b348-83a41470900b for instance 7ab426f8-a759-4d28-b87b-c5a029df5761 on hv-cinder-80403 Jan 28 08:07:12.008053 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-44d8e7a5-9a16-44a6-a339-62c14db383d6 req-853abdd1-0433-4280-b7a9-a0cb84c221d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 Jan 28 08:07:12.009915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 102/189] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:12.489408 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:12.490703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:12.499895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.500970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:12.502920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.504285 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:12.585311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d50fdc45-f55e-4b64-a3ad-aadb683d31c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.092740 Jan 28 08:07:12.585976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 88/190] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:12 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:12.973094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:12.975396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:12.976186 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:12.976335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:12.988078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.988821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:12.989809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.990691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:12.993825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.994471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:12.995517 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:12.996128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:13.110206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dea49354-a3a0-4f74-92e2-e50a91170078 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.139856 Jan 28 08:07:13.112079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 103/191] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:12 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:13.189802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:13.199073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-13db595e-d2b4-4b25-964a-de382932ff47 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.231928 Jan 28 08:07:13.200573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 89/192] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:12 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:13.590675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:13.591855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:13.599056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:13.599661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:13.600537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:13.601063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:13.821540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5ab3337c-abf4-4271-bd63-a5bd44f198fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.234834 Jan 28 08:07:13.827531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 104/193] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:13 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:14.053128 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-615c1a0b-f182-4345-895b-2ab262f4f5fa req-92ac3612-1cb6-457b-b724-00238e471070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:14.054816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:14.054816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:07:14.062155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-615c1a0b-f182-4345-895b-2ab262f4f5fa req-92ac3612-1cb6-457b-b724-00238e471070 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.062650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-615c1a0b-f182-4345-895b-2ab262f4f5fa req-92ac3612-1cb6-457b-b724-00238e471070 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.074878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-615c1a0b-f182-4345-895b-2ab262f4f5fa req-92ac3612-1cb6-457b-b724-00238e471070 service nova] Creating event network-changed:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:07:14.080986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-615c1a0b-f182-4345-895b-2ab262f4f5fa req-92ac3612-1cb6-457b-b724-00238e471070 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030815 Jan 28 08:07:14.081186 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 90/194] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:14.129841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:14.132828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:14.148336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.148780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.149568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.149998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.216811 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:14.217536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:14.224136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.224644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.225488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.225929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.255700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e4314e26-6662-4c1d-a2d2-32c4b07010a0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.134316 Jan 28 08:07:14.256539 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 105/195] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:14 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:14.366069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:14.373840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0ffb250c-c880-4e0e-9f21-6349b5a6b7a2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.160949 Jan 28 08:07:14.374502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 91/196] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:14 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:14.833817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:14.835008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:14.841630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.842080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.842869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:14.843607 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:14.949381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3dfba3fa-8189-4308-bcad-abfaacdc35a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.120338 Jan 28 08:07:14.950060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 106/197] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:14 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:15.267477 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:15.268470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:15.276723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.277168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:15.277950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.278385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:15.391270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:15.391974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:15.398747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.399189 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:15.399973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.400404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:15.535068 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:15.543360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b706f42d-5ca0-41a6-9c58-eb7233f8289f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.156014 Jan 28 08:07:15.546364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 107/198] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:15 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:15.960580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:15.979901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:15.979901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.979901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:15.979901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:15.980363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:19.530827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aa2f12b7-8a31-4218-9bb2-7d23e235fd47 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 4.268382 Jan 28 08:07:19.533890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 92/199] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:15 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 4270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:19.534022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0087a500-3de5-47e2-9a6e-b79327410d7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 3.576673 Jan 28 08:07:19.534415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 108/200] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:15 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 3578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:19.536274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:19.536960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:19.543932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:19.544372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:19.545131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:19.545559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:19.886672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:19.894004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e116b015-071a-46ec-93f2-a32ae80181f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.361385 Jan 28 08:07:19.894575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 93/201] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:19 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:20.542626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:20.543874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:20.545334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:20.546573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:20.550859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.551338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:20.552248 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.552726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:20.558146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.558518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:20.559376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.559837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:20.656313 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cbd45084-83ab-492e-a8ae-341022e0d4f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.115694 Jan 28 08:07:20.657061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 94/202] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:20 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:20.660541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-caaca318-ac8a-457f-905e-a93a535d78c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.122337 Jan 28 08:07:20.661168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 109/203] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:20 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:20.910525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:20.911229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:20.918475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.918933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:20.919830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:20.920276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:21.053348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:21.061154 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-508099ba-6ebb-4792-be9f-92808aee5699 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.154776 Jan 28 08:07:21.061730 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 95/204] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:20 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:21.667894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:21.668867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:21.673578 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:21.675187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:21.676223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:21.676670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:21.677443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:21.677875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:21.681400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:21.682374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:21.683131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:21.683588 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:21.761150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2b4dbca6-6800-4a3b-86ee-9f165e0b751d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.091013 Jan 28 08:07:21.764913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-efb3f99e-faf8-40c9-bdb7-3f10933e7b66 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.101374 Jan 28 08:07:21.765801 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 96/205] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:21 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 08:07:21.766010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 110/206] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:21 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:22.078102 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:22.078808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:22.086440 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.086893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.087709 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.088149 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.218243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:22.226154 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-17484948-0355-4de8-8a6d-77c73a1a6624 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.152148 Jan 28 08:07:22.226716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 97/207] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:22 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:22.774827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:22.775526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:22.775917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:22.776430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:22.782684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.783304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.783385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.783827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.783971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.784405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.784956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:22.785597 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:22.886211 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6f3545aa-9dae-4ce6-be39-fdd27aafa09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.110364 Jan 28 08:07:22.886211 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 98/208] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:22 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:22.897877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bcd69c30-bc5b-4067-be19-987629a3a2a3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.127095 Jan 28 08:07:22.898527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 111/209] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:22 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:23.244427 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:23.245124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:23.252727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.253180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.253938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.254520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.289755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:23.290735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:23.300710 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.301395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.302536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.303324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.343273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:07:23.393172 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:23.401143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a9c7a104-0e06-4ed4-a77a-764d676d2f67 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.160780 Jan 28 08:07:23.401779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 99/210] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:23 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:23.665186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c45f48d6-5fa9-4303-923b-ca8c1ba88968 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 204 len: 0 microversion: 2.1 time: 0.379315 Jan 28 08:07:23.665976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 112/211] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:07:23 2022] DELETE /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 08:07:23.674560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:23.675301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:23.684494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.684953 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.685777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.686216 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.825830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:23.834624 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3e3cdfd6-c86a-4514-a0e7-f6dc756fa130 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1554 microversion: 2.1 time: 0.164342 Jan 28 08:07:23.835235 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 100/212] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:23 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:23.894435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:23.895452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:23.902501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.902971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.903818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.904253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.908901 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:23.910150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:23.930231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.930763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.931754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:23.932263 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:23.990391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f66fc1dc-9c8c-42f3-943c-14035d796125 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.099232 Jan 28 08:07:23.990482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 113/213] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:23 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:24.011905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-57290381-7961-462a-bc32-12972b9cfa28 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.106375 Jan 28 08:07:24.014705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 101/214] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:23 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:24.420287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:24.420287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:24.430375 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:24.430856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:24.431672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:24.432109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:24.563090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:24.570744 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cd850f52-e7ae-492f-a458-1191d59fecf0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.156369 Jan 28 08:07:24.571340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 114/215] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:24 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:24.852369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:24.853062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:24.860078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:24.860521 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:24.862306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:24.862751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.006077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:25.007372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:25.008178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:25.018495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3f57d277-6375-4532-93e6-3bc106acd162 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1554 microversion: 2.1 time: 0.169840 Jan 28 08:07:25.019091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 102/216] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:24 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:25.020520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.020965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.021773 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.027382 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.041664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:25.042857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:25.062138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.066506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.066506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.066506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.118856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ae5745ee-db0f-428e-beac-195fee3d1b09 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.116442 Jan 28 08:07:25.119652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 115/217] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:25 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:25.163089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f2959885-32cd-4395-b16b-bc5fb2054b61 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.137380 Jan 28 08:07:25.164205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 103/218] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:25 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:25.587741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:25.588546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:25.600546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.600546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.600546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:25.600546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:25.762036 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:25.769961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c5724a8d-63b5-49e9-bd0f-cd0331750095 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.186195 Jan 28 08:07:25.772266 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 116/219] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:25 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:26.035507 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:26.036391 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:26.043386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.043838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.044613 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.045050 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.130754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:26.132314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:26.138662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.139118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.139942 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.140381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.182186 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:26.191370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-215867c9-c66b-4e11-b4a6-3a0d18657a84 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1554 microversion: 2.1 time: 0.159711 Jan 28 08:07:26.191951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 104/220] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:26 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:26.196502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:26.197399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:26.204364 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.204808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.206152 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.206580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.244207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d9e34262-fb53-4238-98ab-348d50e2e3bf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.117461 Jan 28 08:07:26.245035 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 117/221] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:26 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:26.294179 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-704b6b5a-dd32-44d0-b91d-147b709d9770 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.101010 Jan 28 08:07:26.297443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 105/222] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:26 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:26.787160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:26.798476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:26.798476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.798476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.798476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:26.799082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:26.938195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:26.948341 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1aa7a8b1-2aa2-4c97-8be8-0045c60bd460 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.165574 Jan 28 08:07:26.951521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 118/223] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:26 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:27.209324 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:27.210044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:27.217068 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.217516 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.218288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.218724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.256508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:27.257586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:27.266678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.269829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.272555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.273227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.358161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a8a1aa9d-5292-4a39-87f1-2671b1264f41 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 14 microversion: 2.20 time: 0.106456 Jan 28 08:07:27.359449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 119/224] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:27 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:27.365371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:27.366659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:27.381612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.383363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.388178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.388808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.483786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c8970ea1-be09-484f-b25e-09df48d81149 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 14 microversion: 2.1 time: 0.122619 Jan 28 08:07:27.484507 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 120/225] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:27 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:27.570693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:27.586017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3d161561-f1a3-4cf7-9bd4-566864ff10e7 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1554 microversion: 2.1 time: 0.374660 Jan 28 08:07:27.586017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 106/226] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:27 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1554 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:27.686828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-d0a6c1ec-4cbd-4d30-8773-c16bea4f03a8 req-067ab971-faa0-427c-87d2-8c6f7beb711f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c754703c-7e85-477c-a969-1c629a198cd3", "name": "network-vif-deleted", "tag": "7c16c6b5-0b52-4684-817d-70da66045d63"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:27.688596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:27.688596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:07:27.697171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d0a6c1ec-4cbd-4d30-8773-c16bea4f03a8 req-067ab971-faa0-427c-87d2-8c6f7beb711f service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.697828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d0a6c1ec-4cbd-4d30-8773-c16bea4f03a8 req-067ab971-faa0-427c-87d2-8c6f7beb711f service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.709654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-d0a6c1ec-4cbd-4d30-8773-c16bea4f03a8 req-067ab971-faa0-427c-87d2-8c6f7beb711f service nova] Creating event network-vif-deleted:7c16c6b5-0b52-4684-817d-70da66045d63 for instance c754703c-7e85-477c-a969-1c629a198cd3 on hv-cinder-80403 Jan 28 08:07:27.715336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-d0a6c1ec-4cbd-4d30-8773-c16bea4f03a8 req-067ab971-faa0-427c-87d2-8c6f7beb711f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 Jan 28 08:07:27.716403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 121/227] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:27.966302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:27.972605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:27.974846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.975587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:27.976432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:27.976799 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.132259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:28.140106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b6c32b24-b7bb-4395-b82b-0ff43bd2a26c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.177552 Jan 28 08:07:28.140789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 107/228] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:27 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:28.369943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:28.371550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:28.378755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.379270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.380090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.380641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.485475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-74ed5052-9ca7-4324-851c-7f4dbd425e77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 1106 microversion: 2.20 time: 0.119876 Jan 28 08:07:28.489547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 122/229] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:28 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 1106 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:07:28.494005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:28.495021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:28.508437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.509096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.510533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.511162 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.598005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:28.598896 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:28.605936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.606464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.607478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.608126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.619897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7e6d0560-49fc-4e7e-8ce2-6b220c8eca49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 6184 microversion: 2.1 time: 0.129585 Jan 28 08:07:28.620656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 108/230] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:28 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 6184 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:28.644968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:28.645415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:28.645867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lazy-loading 'fault' on Instance uuid c754703c-7e85-477c-a969-1c629a198cd3 {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:07:28.692319 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13efd3ecae224a0a93ea82499852061f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f221dadd24c88b4fb86e98b01d2c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:28.701103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c7e43f01-ab97-45be-8797-b7d3a746b51d tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 200 len: 1350 microversion: 2.1 time: 0.107283 Jan 28 08:07:28.707202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 123/231] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:28 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:29.157492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:29.158757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:29.171441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.171441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.171441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.171441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.347223 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:29.356444 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8dead8a0-1161-401c-bff5-cc6bd6e8a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.202895 Jan 28 08:07:29.358227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 109/232] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:29 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:29.497110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:29.498021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:29.508467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.509085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.510035 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.510614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.601229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9eba51bc-9b7e-4a71-80db-8145dab03c6b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 6969 microversion: 2.20 time: 0.106923 Jan 28 08:07:29.601871 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 124/233] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:29 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 6969 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:07:29.630433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:29.631382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:29.637672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.638133 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.638908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.639381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.724371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:29.725063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:29.731925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.732371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.733138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:29.733566 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:29.738721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2e1d3679-759a-4ac1-a31f-17b236e8af03 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 8749 microversion: 2.1 time: 0.110366 Jan 28 08:07:29.738721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 110/234] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:29 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 8749 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:29.748399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] HTTP exception thrown: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. Jan 28 08:07:29.748917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Returning 404 to user: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:29.749746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8bea7199-e763-4c75-8efd-99d36a79d719 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 404 len: 111 microversion: 2.1 time: 0.029938 Jan 28 08:07:29.750287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 125/235] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:29 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:07:30.115476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:30.120579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:30.123436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.123888 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.124883 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.125326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.139201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] HTTP exception thrown: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. Jan 28 08:07:30.139824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Returning 404 to user: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:30.140641 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8141c9ea-b4c7-467e-994e-138ccfc668a0 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029605 Jan 28 08:07:30.141181 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 111/236] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:07:30 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:07:30.373979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:30.374592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:30.380913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.381364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.382228 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.382741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.554880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:30.562954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0a517271-ec35-41c0-b024-3bf72f568a37 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.192658 Jan 28 08:07:30.563585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 126/237] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:30 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:30.616415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:30.617420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:30.624220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.624748 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.625912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.626563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.739696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-82ea3425-e438-4fe4-8280-1fe80da81611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 12758 microversion: 2.20 time: 0.129992 Jan 28 08:07:30.740471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 112/238] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:30 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 12758 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:30.748451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:30.749381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:30.756226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.757363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.757467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:30.757841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:30.837912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9432aa31-7acf-4285-9fca-6eabcebbfe14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 13807 microversion: 2.1 time: 0.093124 Jan 28 08:07:30.838533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 127/239] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:30 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 13807 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:31.583063 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:31.583801 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:31.590156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.590832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:31.591765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.592203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:31.687867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1540186781", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "b961ad58-0562-480d-9a8e-4d9280c8a5d0"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:31.747220 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] validate_networks() for [('b961ad58-0562-480d-9a8e-4d9280c8a5d0', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:07:31.771885 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:31.780651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0071d722-8222-4579-983b-b7e996bdb59d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.203329 Jan 28 08:07:31.781307 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 113/240] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:31 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:31.808377 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:31.810088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:31.816504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.816955 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:31.817739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.818171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:31.907806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7f871a7a-b13e-4037-b5b5-e10cf458f134 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 16877 microversion: 2.20 time: 0.102571 Jan 28 08:07:31.908738 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 114/241] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:31 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 16877 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:31.916586 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:31.918089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:31.926679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.927069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:31.927905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:31.928344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.011841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd2cc48a-a1f8-460f-be99-e554607c8ddf tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 17744 microversion: 2.1 time: 0.100749 Jan 28 08:07:32.014390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 115/242] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:31 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 17744 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:32.191873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:07:32.192477 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:07:32.192983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:07:32.193388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:07:32.193802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:07:32.202643 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.203131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.203958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.204387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.221281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:07:32.225219 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for user cf2c7ab19f374ad39a5c0f21e4e24835 and project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:07:32.235933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:07:32.238802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:07:32.495792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6b26440f-173a-4ef8-a2b1-cd62a60d358d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811826 Jan 28 08:07:32.496437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 128/243] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:07:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 08:07:32.506756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5bde54ff-a231-4e9c-9f96-7aa2e3d45d0c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:32.507744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5bde54ff-a231-4e9c-9f96-7aa2e3d45d0c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:32.562132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5bde54ff-a231-4e9c-9f96-7aa2e3d45d0c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:32.569508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5bde54ff-a231-4e9c-9f96-7aa2e3d45d0c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1218 microversion: 2.1 time: 0.066764 Jan 28 08:07:32.570069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 116/244] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:32 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:32.797938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:32.798549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:32.805040 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.805492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.806262 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.806698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.926694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:32.927856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:32.937451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.937976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.939123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:32.939622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:32.956332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:32.967772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3d0f0c0c-de5f-486b-b9b8-dbc259f43127 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.173453 Jan 28 08:07:32.968346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 129/245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:32 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:33.015543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:33.016240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:33.025586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.026181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.027175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.027690 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.044307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] HTTP exception thrown: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. Jan 28 08:07:33.044927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Returning 404 to user: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:33.045748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6867e13b-1c9c-4ac5-85c2-6798a360ae34 tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 404 len: 111 microversion: 2.1 time: 0.036879 Jan 28 08:07:33.046292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 130/246] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:07:33 2022] DELETE /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:07:33.050843 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:33.052201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:33.057891 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.058337 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.059313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.059754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.076401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d16b4dd3-cfd9-40aa-9155-68c4235ab909 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 17781 microversion: 2.20 time: 0.154993 Jan 28 08:07:33.077638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 117/247] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:32 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 17781 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:33.095525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:33.096798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] [instance: c754703c-7e85-477c-a969-1c629a198cd3] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:33.104255 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.105321 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.106541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.107028 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.122323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] HTTP exception thrown: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. Jan 28 08:07:33.123023 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] Returning 404 to user: Instance c754703c-7e85-477c-a969-1c629a198cd3 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:33.123952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4bdb000c-9cc6-4b17-9738-4a5e3fe9117b tempest-DeleteServersTestJSON-1981209721 tempest-DeleteServersTestJSON-1981209721-project] 10.222.0.42 "GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3" status: 404 len: 111 microversion: 2.1 time: 0.043968 Jan 28 08:07:33.124506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 118/248] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:33 2022] GET /compute/v2.1/servers/c754703c-7e85-477c-a969-1c629a198cd3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:07:33.150290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7d0efa49-a68c-4654-a143-7b7dda53213a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 17744 microversion: 2.1 time: 0.102195 Jan 28 08:07:33.151384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 131/249] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:33 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 17744 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:33.586732 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:33.587511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:33.593615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.594070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.594843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.595310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.675654 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:33.692099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ee2971ab-6d5c-43c3-b60f-09d013546e4b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1222 microversion: 2.1 time: 0.109051 Jan 28 08:07:33.692858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 119/250] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:33 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:33.985760 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:33.987166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:33.994298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.995089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:33.995912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:33.996334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.093475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:34.097584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:34.105313 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.105779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.106575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.107015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.169259 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:34.178226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-12a30947-6332-4c66-8f44-e6bca4d99d41 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.196470 Jan 28 08:07:34.179058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 132/251] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:33 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:34.183947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:34.184893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:34.192645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.192645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.192645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.192993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.235357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-adbe294b-2ed4-4256-a768-5f43760a318f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 19243 microversion: 2.20 time: 0.150258 Jan 28 08:07:34.236507 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 120/252] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:34 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 19243 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:34.301983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f57dd921-bcce-4da9-b2c0-31edce6d48c9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 19342 microversion: 2.1 time: 0.121495 Jan 28 08:07:34.302630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 133/253] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:34 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 19342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:34.709327 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:34.710154 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:34.717705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.718384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.719457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:34.720109 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:34.798991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:34.807024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d434649b-8dff-4f54-8527-cd559faa51fd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1270 microversion: 2.1 time: 0.101699 Jan 28 08:07:34.807825 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 121/254] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:34 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:35.195153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:35.195898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:35.213513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.213513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.213513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.213513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.247404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:35.253577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:35.255568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.256026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.256816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.257266 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.342241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:35.350409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-49195d36-af2a-4b36-99b4-a1b9e8b96dda tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.159186 Jan 28 08:07:35.350978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 134/255] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:35 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:35.362638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c74199a7-31cd-41d4-ac04-8cb9630ccec5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 20991 microversion: 2.20 time: 0.118742 Jan 28 08:07:35.362838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:35.363929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 122/256] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:35 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 20991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:35.364120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:35.370187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.370733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.371521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.371950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.462427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d4825e39-b5aa-4d66-8b8a-5658ddcfdc42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 21337 microversion: 2.1 time: 0.110186 Jan 28 08:07:35.463267 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 135/257] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:35 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 21337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:35.826071 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:35.827006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:35.835397 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.835703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.836473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:35.836904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:35.899877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:35.907692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7f6c55e1-f025-4ad8-89a0-39ea72f93507 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1278 microversion: 2.1 time: 0.086626 Jan 28 08:07:35.908475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 123/258] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:35 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:36.368488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:36.369181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:36.374651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:36.375597 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:36.376828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.377283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.378069 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.378504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.381922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.382374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.383169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.384067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.483920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-463c2718-d77a-4420-8ff0-8db067f8b83f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 22219 microversion: 2.20 time: 0.112717 Jan 28 08:07:36.488703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 124/259] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:36 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 22219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:36.496985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:36.498297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:36.508964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.509584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.511810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.512438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.564490 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:36.573480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1e7e0860-d0f2-4765-9bc3-4aa7914770b2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.209057 Jan 28 08:07:36.576212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 136/260] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:36 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:36.633323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-77df0671-670d-47e7-bda9-b22a9824383b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 22758 microversion: 2.1 time: 0.142820 Jan 28 08:07:36.637314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 125/261] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:36 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 22758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:36.927454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:36.928495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:36.935692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.936816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.937926 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:36.938538 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:36.974747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-804742df-e637-4563-8788-630d340142b6 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Action: 'create', calling method: .version_select at 0x7f347428a430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1979164100", "metadata": {"Type": "work"}}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:37.182586 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:37.189970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cc9d37f7-003d-43bd-b80f-c39d1fb31f48 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.268270 Jan 28 08:07:37.190544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:36 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:37.495612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:37.496531 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:37.504036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.504478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.505261 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.505698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.603368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1aff4065-d0fd-4103-94b3-f19a826428ba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 23041 microversion: 2.20 time: 0.111201 Jan 28 08:07:37.604043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 127/263] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:37 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 23041 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:37.608862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:37.609593 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:37.616511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.616969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.617741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.618177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.810089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:37.817886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2e314790-d5c9-4158-8994-80cb6b0636a7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.212749 Jan 28 08:07:37.818459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 128/264] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:37 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:37.822673 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:37.823591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:37.828953 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.829449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.830754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.831195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.913250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-25acb880-7c4f-4da5-8d6a-4563dd8ab8b8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 23565 microversion: 2.1 time: 0.093337 Jan 28 08:07:37.913652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 129/265] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:37 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 23565 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:37.922244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-625cf2e3-4a4c-45a6-b440-eb9587acfdb9 req-a6217dc0-d968-4a75-be79-48fa697ca8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a432d54-4c12-4ab0-a857-792f33ca153c", "tag": "948eb4ed-3bbe-4557-9569-d90bbd45ccda"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:37.924345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:37.924345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:07:37.942382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-625cf2e3-4a4c-45a6-b440-eb9587acfdb9 req-a6217dc0-d968-4a75-be79-48fa697ca8fd service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:37.942824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-625cf2e3-4a4c-45a6-b440-eb9587acfdb9 req-a6217dc0-d968-4a75-be79-48fa697ca8fd service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:37.956314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-625cf2e3-4a4c-45a6-b440-eb9587acfdb9 req-a6217dc0-d968-4a75-be79-48fa697ca8fd service nova] Creating event network-changed:948eb4ed-3bbe-4557-9569-d90bbd45ccda for instance 8a432d54-4c12-4ab0-a857-792f33ca153c on hv-cinder-80403 Jan 28 08:07:37.961044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-625cf2e3-4a4c-45a6-b440-eb9587acfdb9 req-a6217dc0-d968-4a75-be79-48fa697ca8fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046089 Jan 28 08:07:37.961880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 130/266] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:38.098603 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-804742df-e637-4563-8788-630d340142b6 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.377623 Jan 28 08:07:38.099860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 137/267] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jan 28 08:07:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1380 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 08:07:38.111772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0119160d-d9db-4991-baf9-3bf3b3d4a1b5 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741bb700>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:38.160497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0119160d-d9db-4991-baf9-3bf3b3d4a1b5 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 200 len: 353 microversion: 2.1 time: 0.050754 Jan 28 08:07:38.160497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 131/268] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:38 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:38.207474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:38.208098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:38.214053 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.214513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.215469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.215910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.364746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:38.371926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-64e24df5-c00f-4c99-9414-340d43bccf0d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.168870 Jan 28 08:07:38.372493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 138/269] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:38 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:38.615289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:38.616286 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:38.623323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.623775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.624561 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.624996 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.835221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:38.835866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:38.841847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.842296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.843078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.843576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.880443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b64bd684-375d-4837-88b3-34774169d4f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 24459 microversion: 2.20 time: 0.269920 Jan 28 08:07:38.881094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 132/270] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:38 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 24459 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:38.925740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:38.926743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:38.933995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.934449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.935230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:38.935691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:38.980023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:38.987391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6574db23-92ee-4e50-ba7d-ea071d0ebaf6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.156595 Jan 28 08:07:38.987960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 139/271] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:38 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:39.021542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ba7d1104-529a-4cb4-9440-a84b21b5e31e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 24674 microversion: 2.1 time: 0.099836 Jan 28 08:07:39.022279 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 133/272] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:38 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 24674 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:39.170120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5b78d95d-3393-44e4-892d-be95ecf277ba tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741ff3a0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:39.216625 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5b78d95d-3393-44e4-892d-be95ecf277ba tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 200 len: 353 microversion: 2.1 time: 0.050284 Jan 28 08:07:39.217066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 140/273] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:39 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:39.388362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:39.389104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:39.396455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:39.396905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:39.397671 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:39.398106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:39.534948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:39.539875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-79cd32d3-52ef-4c06-84ba-0ebc4d485152 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.155623 Jan 28 08:07:39.540450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 134/274] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:39 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:39.893198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:39.894195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:39.900132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:39.900889 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:39.901661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:39.902103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.004368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.005037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:40.006937 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ccb434a9-f591-4ff6-ac2f-89b8ea04d376 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 25660 microversion: 2.20 time: 0.118356 Jan 28 08:07:40.011088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 141/275] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:39 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 25660 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:40.011401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.011849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.012616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.013045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.033741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:40.034758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:40.041574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.042293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.043069 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.043535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.141878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:40.150083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bd454c6f-58b6-43c3-b2b1-240a24a09447 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.149944 Jan 28 08:07:40.150651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 135/276] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:39 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:40.196255 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6a921464-814f-4f06-8f06-fbcbb204c268 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 25844 microversion: 2.1 time: 0.166340 Jan 28 08:07:40.196897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 142/277] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:40 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 25844 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:40.228348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-860ec36a-c5e8-4316-bca1-ffaf913d7955 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741a9040>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.280396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-860ec36a-c5e8-4316-bca1-ffaf913d7955 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 200 len: 354 microversion: 2.1 time: 0.055513 Jan 28 08:07:40.281045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 136/278] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:40 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:40.292719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3fa7b9bb-61ee-4eda-95b5-c8d22cbc0694 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741ff550>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.339055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3fa7b9bb-61ee-4eda-95b5-c8d22cbc0694 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 200 len: 354 microversion: 2.1 time: 0.050262 Jan 28 08:07:40.339453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 143/279] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:40 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:40.350558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-76314c57-b459-4f83-890e-6b1f50370712 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34742515e0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.557152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.557882 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:40.564139 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.565097 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.568494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:40.568494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:40.692307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:40.699487 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8498063b-7749-4cda-8156-73b08ad8379a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.146451 Jan 28 08:07:40.700060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 144/280] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:40 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:40.767404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-76314c57-b459-4f83-890e-6b1f50370712 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 202 len: 0 microversion: 2.1 time: 0.420223 Jan 28 08:07:40.768338 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 137/281] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:07:40 2022] DELETE /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:40.776205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-95d9b2f9-06c2-4186-8083-26f2baaa54cd tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741ffee0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:40.825195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-95d9b2f9-06c2-4186-8083-26f2baaa54cd tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 200 len: 353 microversion: 2.1 time: 0.052670 Jan 28 08:07:40.825775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 145/282] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:40 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:41.019609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:41.020583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:41.028763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.029989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.030097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.030529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.126913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fcea195c-002c-4d01-873c-2e1d39e99a32 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 26634 microversion: 2.20 time: 0.111753 Jan 28 08:07:41.127605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 138/283] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:41 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 26634 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:41.165899 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:41.166511 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:41.173295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.173806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.174586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.175020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.209206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:41.210562 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:41.218534 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.218990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.219988 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.221007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.307778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:41.315832 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b7d5f1af-035f-4fe2-b437-71c8059cee80 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.153980 Jan 28 08:07:41.316400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 146/284] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:41 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:41.369033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fa1893d5-a971-4cd7-85b1-7cc1fbb56832 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 26900 microversion: 2.1 time: 0.164503 Jan 28 08:07:41.369688 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 139/285] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:41 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 26900 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:41.716110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:41.716717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:41.722850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.723328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.724094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:41.724522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:41.837957 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-27865f43-648f-4416-97c3-4c9ca0660774 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Calling method '.version_select at 0x7f34741595e0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:41.853200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:41.860655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1dadb880-daa5-4dd2-85ba-8acecff88157 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.148132 Jan 28 08:07:41.861235 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 147/286] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:41 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:41.871464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-27865f43-648f-4416-97c3-4c9ca0660774 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] HTTP exception thrown: Volume 5d736606-242d-4de9-b101-ce8f62e2068d could not be found. Jan 28 08:07:41.872067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-27865f43-648f-4416-97c3-4c9ca0660774 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] Returning 404 to user: Volume 5d736606-242d-4de9-b101-ce8f62e2068d could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:41.872934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-27865f43-648f-4416-97c3-4c9ca0660774 tempest-VolumesGetTestJSON-2031293417 tempest-VolumesGetTestJSON-2031293417-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d" status: 404 len: 109 microversion: 2.1 time: 0.039199 Jan 28 08:07:41.874268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 140/287] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:41 2022] GET /compute/v2.1/os-volumes/5d736606-242d-4de9-b101-ce8f62e2068d => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:07:42.138504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:42.139499 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:42.145317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.146406 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.146568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.146946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.256215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f7ea3bd8-3f17-4bba-83be-df9149c30e28 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 27175 microversion: 2.20 time: 0.121198 Jan 28 08:07:42.257611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 148/288] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:42 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 27175 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:42.332788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:42.333633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:42.339502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.339950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.341348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.341863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.381604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:42.382635 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:42.389498 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.389945 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.390720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.391149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.483014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:42.490775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0c408471-f225-4105-a366-9a590c7e88d7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.162232 Jan 28 08:07:42.491373 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 141/289] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:42 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:42.880352 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:42.881378 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:42.888240 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.889122 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:42.893376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:42.893376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:43.020305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:43.027867 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aa0dc40e-4413-458f-b077-728c362d2023 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.153414 Jan 28 08:07:43.028443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:42 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:43.267496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:43.268544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:43.274924 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:43.275796 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:43.276168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:43.276595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:46.270814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-87e2bda4-e197-424b-a33f-03125b276795 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 27822 microversion: 2.1 time: 3.893191 Jan 28 08:07:46.274703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 149/291] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:42 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 27822 bytes in 3895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:46.276208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:46.276898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:46.284258 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:46.284706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:46.285474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:46.285908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:46.425791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:46.433082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2d6639cf-1ac1-4498-8c93-d97055519d43 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.160509 Jan 28 08:07:46.436265 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 150/292] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:46 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:46.437752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:46.438348 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:46.443950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:46.444398 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:46.445163 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:46.445596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:46.582145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c6fa4b25-137d-4520-aec0-a06a2f1e80bb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 27855 microversion: 2.20 time: 3.317600 Jan 28 08:07:46.586366 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 143/293] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:43 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 27855 bytes in 3321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:46.591966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:46.599787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-01a8605b-dd7d-4453-8543-50f09ffa9444 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.165200 Jan 28 08:07:46.600348 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 151/294] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:46 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:47.282485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:47.283518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:47.290775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.291214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.292302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.292735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.432930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f3d93b12-f2b2-40bf-9149-8814e28fae56 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 27822 microversion: 2.1 time: 0.154330 Jan 28 08:07:47.433693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 144/295] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:47 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 27822 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:47.449469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:47.450079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:47.456377 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.456826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.457596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.458028 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.594660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:47.595151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:47.595698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:47.603051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-08c42603-ec96-470c-8110-8d769ffdb3f3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.157174 Jan 28 08:07:47.603204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.603652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 152/296] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:47 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:47.603762 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.604466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.604978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.615663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:47.616299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:47.621886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.622330 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.623113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:47.623580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:47.752243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:47.759494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-806ef723-2853-4bf0-9307-4618933915e7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.147785 Jan 28 08:07:47.760063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 153/297] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:47 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:47.765256 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-960985f7-9dcd-412d-b407-212d9e46061a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 27855 microversion: 2.20 time: 0.174681 Jan 28 08:07:47.769868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 145/298] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:47 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 27855 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:47.955225 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-64c07804-df04-46ac-b513-2015216816a0 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f3474172af0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:48.000050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-64c07804-df04-46ac-b513-2015216816a0 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7a4280a9-ac7e-4a8e-8518-567832141c1a" status: 200 len: 351 microversion: 2.1 time: 0.048490 Jan 28 08:07:48.000721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 154/299] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:47 2022] GET /compute/v2.1/os-volumes/7a4280a9-ac7e-4a8e-8518-567832141c1a => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:48.431751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-5c265220-a33a-4e4a-af59-7b71292fcf0c req-0a405ec1-2eee-45e4-a811-e8ebb78af751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a432d54-4c12-4ab0-a857-792f33ca153c", "name": "network-vif-plugged", "status": "completed", "tag": "948eb4ed-3bbe-4557-9569-d90bbd45ccda"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:48.433269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:07:48.433269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:07:48.441046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-5c265220-a33a-4e4a-af59-7b71292fcf0c req-0a405ec1-2eee-45e4-a811-e8ebb78af751 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.441560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-5c265220-a33a-4e4a-af59-7b71292fcf0c req-0a405ec1-2eee-45e4-a811-e8ebb78af751 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.443961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:48.444955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:48.453197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.453785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.454736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.454833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.460161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-5c265220-a33a-4e4a-af59-7b71292fcf0c req-0a405ec1-2eee-45e4-a811-e8ebb78af751 service nova] Creating event network-vif-plugged:948eb4ed-3bbe-4557-9569-d90bbd45ccda for instance 8a432d54-4c12-4ab0-a857-792f33ca153c on hv-cinder-80403 Jan 28 08:07:48.473037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-5c265220-a33a-4e4a-af59-7b71292fcf0c req-0a405ec1-2eee-45e4-a811-e8ebb78af751 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037964 Jan 28 08:07:48.473037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 146/300] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:48.564361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0d263244-d269-42dd-a957-ae8b145a11f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 27949 microversion: 2.1 time: 0.123784 Jan 28 08:07:48.565020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 155/301] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:48 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 27949 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:48.620916 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:48.621630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:48.627745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.628221 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.629177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.629615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.759206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:48.766602 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-701b1819-2c55-43f1-9105-ddbf9079ed8a tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.150129 Jan 28 08:07:48.767178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 147/302] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:48 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:48.776803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:48.777512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:48.781319 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:48.783171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:48.785465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.786114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.787107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.787750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.789154 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.789773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.790703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:48.791329 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:48.926701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:48.934505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a089a5d8-b75f-4518-a367-f294ffaa93b5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.161982 Jan 28 08:07:48.935094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 156/303] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:48 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:49.250385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4ad9ed35-d438-4e8a-b241-0f99c5410047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28100 microversion: 2.20 time: 0.472628 Jan 28 08:07:49.251036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 148/304] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:48 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28100 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:49.575361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:49.576331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:49.582622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.583066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:49.583864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.584295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:49.661554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dd5516ec-9d9f-4104-afe0-0cc0d1d6c333 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28125 microversion: 2.1 time: 0.089779 Jan 28 08:07:49.662573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 157/305] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:49 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28125 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:49.687005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cc877624-a362-4f4f-b3ec-628860099857 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f3475eb03a0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:49.747705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cc877624-a362-4f4f-b3ec-628860099857 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/54321079-bc23-4b95-8a14-1dbc0c1d3143" status: 200 len: 350 microversion: 2.1 time: 0.068238 Jan 28 08:07:49.748277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 149/306] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:49 2022] GET /compute/v2.1/os-volumes/54321079-bc23-4b95-8a14-1dbc0c1d3143 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:49.783644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:49.784380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:49.792909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.793407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:49.794193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.794630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:49.928715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:49.935888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f0f2ec86-85d0-4b06-a5c6-b85a6d29d1dc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.156336 Jan 28 08:07:49.936535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 158/307] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:49 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:49.953010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:49.953745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:49.959745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.960192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:49.961198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:49.961569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.093442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:50.100872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a5f25eb9-1f4f-4f24-aa2b-275518e91459 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1318 microversion: 2.1 time: 0.152998 Jan 28 08:07:50.101446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 150/308] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:49 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:50.262620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:50.263719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:50.270297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.271107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.271776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.272216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.357893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4828a99f-9dcf-4eb2-a36d-7521f23267e0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.099134 Jan 28 08:07:50.361746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 159/309] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:50 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:50.673421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:50.674373 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:50.681243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.681690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.682460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.682894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.871589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-757555a0-7cb6-4cef-9e3a-de62f405650f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.201781 Jan 28 08:07:50.872232 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 151/310] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:50 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:50.953934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:50.954658 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:50.961886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.962339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:50.963132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:50.963640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.093938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:51.102325 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ac04e438-1ed6-4f2f-9f31-8d647a855d7c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.152570 Jan 28 08:07:51.102883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 160/311] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:50 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:51.118068 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:51.118757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.125436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.125873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.126635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.127062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.305998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:51.313471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b356eb46-2750-40c9-aab5-1bbf99712cab tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1509 microversion: 2.1 time: 0.199308 Jan 28 08:07:51.314313 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 152/312] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:51 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:51.330372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3d38647-0824-4674-8ecf-0927e41c0322"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:51.332062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.338679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.339297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.340192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.340727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.369498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:51.370418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.376302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.376987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.377873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.378946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.433146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Invalid volume: volume a3d38647-0824-4674-8ecf-0927e41c0322 is already attached to instances: cc0612c4-618b-450a-a6dc-bd226fcde646 Jan 28 08:07:51.433748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 400 to user: Invalid volume: volume a3d38647-0824-4674-8ecf-0927e41c0322 is already attached to instances: cc0612c4-618b-450a-a6dc-bd226fcde646 {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:07:51.434569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3df8e462-d4ad-47ff-b7a1-92cf7e47cc1f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108076 Jan 28 08:07:51.435125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 161/313] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:07:51 2022] POST /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:07:51.455202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-eb6dc93e-2b77-4be8-91f5-d41c100998dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.088936 Jan 28 08:07:51.465445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 153/314] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:51 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:51.494337 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:51.494822 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.500629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.501068 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.503900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.503900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.619988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lazy-loading 'services' on Instance uuid cc0612c4-618b-450a-a6dc-bd226fcde646 {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:07:51.882740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:51.883903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.890753 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.891331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.892213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.892767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.943550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9f5fff3c-9b64-4a34-9d32-86f5916a5ae1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments/a3d38647-0824-4674-8ecf-0927e41c0322" status: 202 len: 0 microversion: 2.1 time: 0.452725 Jan 28 08:07:51.944206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 162/315] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:07:51 2022] DELETE /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments/a3d38647-0824-4674-8ecf-0927e41c0322 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:51.953754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:51.954898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:51.961521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.961963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.962755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:51.963198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:51.969429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1047634d-9f02-4387-a258-541ca08f790f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.090513 Jan 28 08:07:51.970083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 154/316] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:51 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:51.994037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-15209cb5-f0d1-4844-b970-352dde3eebe3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Jan 28 08:07:51.994515 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 163/317] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:07:51 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:07:52.120002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.120802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:52.127754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.128208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:52.128995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.129429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:52.277714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:52.285574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0431bb7f-1910-4366-94d1-502550d8e191 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.169627 Jan 28 08:07:52.286156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 155/318] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:52.435035 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-31f0269f-21ea-49ee-891f-61ce68032781 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741bfca0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.476020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:52.477026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:52.486207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.486930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:52.488282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.488933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:52.512400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-31f0269f-21ea-49ee-891f-61ce68032781 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bee33bf2-23db-4fbe-bc33-7a97db46399f" status: 200 len: 351 microversion: 2.1 time: 0.080926 Jan 28 08:07:52.520304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 164/319] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/os-volumes/bee33bf2-23db-4fbe-bc33-7a97db46399f => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:52.528834 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-281c9498-eee8-42a0-ae8e-8a2ea96d0080 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f3474137940>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.583607 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-87090e89-7114-426a-921e-3b7bd2568296 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.113983 Jan 28 08:07:52.584881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 156/320] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:52 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:07:52.617257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-281c9498-eee8-42a0-ae8e-8a2ea96d0080 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095738 Jan 28 08:07:52.617859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 165/321] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:52.632174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ed5d21d3-f643-4fbc-9c02-82ac50ccde72 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f3474251b80>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.720160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ed5d21d3-f643-4fbc-9c02-82ac50ccde72 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092422 Jan 28 08:07:52.720770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 157/322] 10.222.0.42 () {58 vars in 1148 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:52.732380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-97b4d2e1-480f-48d5-a108-fc8c13275c59 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741ffa60>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.810435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-97b4d2e1-480f-48d5-a108-fc8c13275c59 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081620 Jan 28 08:07:52.811098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 166/323] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:52.826089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-abd86c2e-9af5-41bb-84b9-78860f20c327 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741d79d0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:52.986452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:52.989012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:52.996063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.996836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:52.997857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:52.998439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.050868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-abd86c2e-9af5-41bb-84b9-78860f20c327 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.227768 Jan 28 08:07:53.051490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 158/324] 10.222.0.42 () {58 vars in 1166 bytes} [Fri Jan 28 08:07:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:53.056471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.057384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:53.064592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.065039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.066400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.067036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.083895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7a78ab75-e6ba-4fb0-90df-c50d79ac9ee6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.101263 Jan 28 08:07:53.084606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 167/325] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:52 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:07:53.089696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c0ab9525-e322-473d-b72c-d7cc4fd15357 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741ffee0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.100464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-efce4e86-9ebb-4174-9b1c-02202bce6720 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Jan 28 08:07:53.101149 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 159/326] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:53.178242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c0ab9525-e322-473d-b72c-d7cc4fd15357 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092378 Jan 28 08:07:53.179183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 168/327] 10.222.0.42 () {58 vars in 1169 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:53.191482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-88098d8c-2386-47a0-b73d-88ee59aa7be1 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741b8550>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.289297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-88098d8c-2386-47a0-b73d-88ee59aa7be1 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101635 Jan 28 08:07:53.289852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 160/328] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:53.301857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c9a886b2-cde9-419e-9328-03e2f2bdda29 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741c8d30>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.303847 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.304411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:53.325411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.326049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.326857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.327321 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.405869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c9a886b2-cde9-419e-9328-03e2f2bdda29 tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.108132 Jan 28 08:07:53.410286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 169/329] 10.222.0.42 () {58 vars in 1187 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:07:53.422630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bde88905-69bf-4aab-99b7-2a8d81f666fb tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] Calling method '.version_select at 0x7f34741faee0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:53.466468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:53.477079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e29d7787-73a6-4b67-b2b4-35a6ba4692f6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1520 microversion: 2.1 time: 0.176761 Jan 28 08:07:53.479592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 161/330] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:53.510981 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bde88905-69bf-4aab-99b7-2a8d81f666fb tempest-VolumesTestJSON-1351618467 tempest-VolumesTestJSON-1351618467-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091705 Jan 28 08:07:53.511586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 170/331] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jan 28 08:07:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:53.595175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:53.596342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:53.603273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.603709 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.604711 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:53.605297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:53.670437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9f0bdc37-e940-4c73-8742-caba6db87291 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.078740 Jan 28 08:07:53.671308 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 162/332] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:53 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:54.101011 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:54.101011 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:54.105671 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.106175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.107494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.108088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.112872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:54.113903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:54.120744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.121207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.121970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.122399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.154173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-32fe3d64-b202-4694-bd7f-a9e5da135b49 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045640 Jan 28 08:07:54.154729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 163/333] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:07:54 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 08:07:54.183749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3788d490-86d3-466f-bcbf-84f283453ecd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.090898 Jan 28 08:07:54.185134 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 171/334] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:54 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:54.367891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-988624807", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "b961ad58-0562-480d-9a8e-4d9280c8a5d0"}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:54.419446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] validate_networks() for [('b961ad58-0562-480d-9a8e-4d9280c8a5d0', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:07:54.494081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:54.494814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:54.501624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.502072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.502851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.503324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.643112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:54.651606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-63451221-e74e-4e52-8d3b-0f22fb5f631b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1500 microversion: 2.1 time: 0.161510 Jan 28 08:07:54.652169 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 172/335] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:54 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:54.667587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:54.668201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:54.674063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.674515 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.675874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.676310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.807449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:07:54.807881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:07:54.808360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:07:54.808771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:07:54.811691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:07:54.812308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:54.820824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-30017dcb-df91-401d-8662-fb1b74a09a13 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1514 microversion: 2.1 time: 0.156984 Jan 28 08:07:54.821200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.821497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 173/336] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:54 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:54.822031 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.822928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.823464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.825857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:54.827160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:54.843506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.844674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:07:54.844992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.847774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:54.849252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for user cf2c7ab19f374ad39a5c0f21e4e24835 and project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:07:54.849372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:54.867801 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:07:54.867801 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:07:54.919347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f8e8df0e-9ef0-48a0-9e33-7a3ec847cdad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.095739 Jan 28 08:07:54.920202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 174/337] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:54 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:55.061234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-788d7e04-fcb5-4492-9150-458a5e2f4d1c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697152 Jan 28 08:07:55.061875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 164/338] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:07:55.072158 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2f01b190-4f4f-42aa-aeb1-db630c332741 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:55.072855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2f01b190-4f4f-42aa-aeb1-db630c332741 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:55.130075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2f01b190-4f4f-42aa-aeb1-db630c332741 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:55.137133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2f01b190-4f4f-42aa-aeb1-db630c332741 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1217 microversion: 2.1 time: 0.069024 Jan 28 08:07:55.137686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 175/339] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:55 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:55.194792 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:55.195846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:55.202106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:55.202560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:55.203368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:55.205838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:55.274360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0ea0ce42-f8b4-43f4-ac7d-aea60be08413 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.083574 Jan 28 08:07:55.275284 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 165/340] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:55 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:55.932241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:55.933114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:55.939611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:55.940072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:55.941415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:55.941852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:56.004980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-66d44a41-ce9f-4bc5-a50f-7d970634f68d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.077445 Jan 28 08:07:56.006456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 176/341] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:55 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:56.155083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:56.155876 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:56.163846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:56.164290 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:56.165081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:56.165518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:56.228547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:56.236599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9b50e585-789c-4cfd-bd75-253fd2b51089 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1221 microversion: 2.1 time: 0.085534 Jan 28 08:07:56.237183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 166/342] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:56 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:56.286376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:56.287363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:56.294590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:56.295034 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:56.295845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:56.296273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:56.382992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-801a4c1e-b18d-4c0a-82d1-87084e611c30 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.100478 Jan 28 08:07:56.387066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 177/343] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:56 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:57.017152 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:57.018067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:57.024431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.024884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.025722 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.026225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.092851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b2a92ff9-42db-4bca-8b70-7c6e523b51b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.079257 Jan 28 08:07:57.093506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 167/344] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:57 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:07:57.258874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:57.259633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:57.266710 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.267166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.267978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.268421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.335590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:57.343763 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-adb091f4-0565-4b4d-84d1-52c54966e557 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1269 microversion: 2.1 time: 0.089946 Jan 28 08:07:57.344442 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 178/345] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:57 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:57.395193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:57.396313 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:57.403656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.404112 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.404902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.405428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.482544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5b6bff84-14d8-4724-a279-97bafafb0ed6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.091872 Jan 28 08:07:57.483351 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 168/346] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:57 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:07:57.874345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:57.875320 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:57.883603 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.884063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.885022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:57.885623 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:57.912957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'flavor' on Instance uuid d4e823ff-de17-4756-8990-8c2cdc9bd349 {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:07:58.104849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:58.106150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:58.113347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.113591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.114416 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.114867 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.242114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c39b5e06-229b-4dfe-8410-06d45db5227c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action" status: 200 len: 32 microversion: 2.1 time: 0.372016 Jan 28 08:07:58.242731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 179/347] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:57 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:07:58.251785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:58.252479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:58.259503 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.259964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.260754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.261194 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.469302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:58.477474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ed7cbb7d-8dfe-46f7-ba83-1a318b04662d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.229452 Jan 28 08:07:58.478061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 180/348] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:58 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:07:58.486807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:07:58.487469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:58.493225 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.493835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.494758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.495469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.661999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:07:58.669648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-929937bc-18fe-4c7b-9170-e67ec1f71faa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.186378 Jan 28 08:07:58.670307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 181/349] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:07:58 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:07:58.674771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:07:58.675997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:07:58.681905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.682433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:07:58.683291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:07:58.683724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:02.721473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-15d3075f-a92b-4537-a453-341f5f7844cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 4.620751 Jan 28 08:08:02.722700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 169/350] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:07:58 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 4623 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:02.727611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:02.728299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:02.729253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-59aad3fe-791f-46cf-af40-434884a73e46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 4.057640 Jan 28 08:08:02.731929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 182/351] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:07:58 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:02.735568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:02.736257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:02.736395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:02.736757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:02.737548 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:02.737973 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:02.744213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:02.744739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:02.745600 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:02.746103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:02.968596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:02.982550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bfcc5f49-834d-4290-a466-2ff2674e5ae5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.250784 Jan 28 08:08:02.983831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:02.988633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 183/352] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:02 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:02.995482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e08ff73c-c02c-4c24-9a46-e78dad0da95f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.271088 Jan 28 08:08:02.996342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 170/353] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:02 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:03.205416 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-84b1afac-1074-4dcb-b6a8-f65d6887ae0e req-07252d08-577a-49bd-a2cf-c6401d2841d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85aa54d-ba74-47b8-9b76-f6e864410c3f", "tag": "c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:03.207012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:03.207012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:08:03.215194 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-84b1afac-1074-4dcb-b6a8-f65d6887ae0e req-07252d08-577a-49bd-a2cf-c6401d2841d2 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:03.215641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-84b1afac-1074-4dcb-b6a8-f65d6887ae0e req-07252d08-577a-49bd-a2cf-c6401d2841d2 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:03.244860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-84b1afac-1074-4dcb-b6a8-f65d6887ae0e req-07252d08-577a-49bd-a2cf-c6401d2841d2 service nova] Creating event network-changed:c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1 for instance c85aa54d-ba74-47b8-9b76-f6e864410c3f on hv-cinder-80403 Jan 28 08:08:03.249735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-84b1afac-1074-4dcb-b6a8-f65d6887ae0e req-07252d08-577a-49bd-a2cf-c6401d2841d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047827 Jan 28 08:08:03.250405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 184/354] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:03.733438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:03.734358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:03.742950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:03.743471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:03.744260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:03.744884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:03.747532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:03.748594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:03.762740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:03.766525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:03.766525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:03.766525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:03.825690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7737e462-9147-4834-b4ce-319b18817aa2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.095951 Jan 28 08:08:03.826340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 171/355] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:03 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:03.962905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e387a4b9-a110-4207-b27b-e49baf3732fa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.224873 Jan 28 08:08:03.968553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 185/356] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:03 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:04.002581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:04.003540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:04.012084 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.012858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.013888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:04.014169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.014705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.015111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:04.022273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.022732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.023715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.024314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.180725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:04.188644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c428e292-5b59-4623-867d-602bbb4ffe3e tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.178739 Jan 28 08:08:04.189227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 186/357] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:04 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:04.221465 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:04.229496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bfbd2262-42a4-4b04-a02e-1c67eaf8c9a4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.230984 Jan 28 08:08:04.229990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 172/358] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:03 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:04.836972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:04.837921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:04.844473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.844919 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.845714 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.846150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.929629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a99015c6-ee6e-4e02-ab69-7d6603862172 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.096265 Jan 28 08:08:04.930290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 187/359] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:04 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:04.975989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:04.976906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:04.983195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.983663 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:04.984464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:04.984920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.101693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2f610db2-b802-4761-86a2-b8883f9208f5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.129769 Jan 28 08:08:05.102269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 173/360] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:04 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:05.205913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:05.207128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:05.214052 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.214508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.215310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.215764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.246740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:05.247493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:05.271451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.277428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.277428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.277428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.366216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:05.373958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4e19197a-d55d-4cf6-b822-77a1709fda2b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.172084 Jan 28 08:08:05.374562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 188/361] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:05 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:05.415272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:05.422699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bb8e0480-6afd-4f2a-a0f3-fdd0e88f2869 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.179925 Jan 28 08:08:05.423280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 174/362] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:05 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:05.944629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:05.946403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:05.952695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.953147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:05.953936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:05.954725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.025592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c59d993a-85e3-4f74-9f8e-f3f21bcd3198 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.088456 Jan 28 08:08:06.027568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 189/363] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:05 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:06.113003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:06.114626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:06.121064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.121712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.122773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.122931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.211598 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f075a30d-53b2-43cd-a88b-448a6dc35daa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.102580 Jan 28 08:08:06.212453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 175/364] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:06 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:06.391984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:06.392915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:06.413929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.414391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.415238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.415772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.440291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:06.442158 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:06.449590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.450123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.451139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:06.451684 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:06.624639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:06.632815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c6437659-8043-462b-81af-0648671a2f04 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.245089 Jan 28 08:08:06.633395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 190/365] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:06 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:06.659583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:06.667100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-126eb024-ad7e-4a0a-8d6f-af5cf629f4d1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.230674 Jan 28 08:08:06.667746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 176/366] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:06 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:07.037973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:07.038901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:07.045507 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.045951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.046735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.047166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.174623 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4fb7b1e0-fc20-4d7b-8b96-04056dc68290 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.141339 Jan 28 08:08:07.176065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 191/367] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:07 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:07.228631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:07.229651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:07.236907 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.237371 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.238176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.238681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.373638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-39d58647-47c8-42e8-82dc-d0e1bae477fc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.153342 Jan 28 08:08:07.374285 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 177/368] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:07 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:07.650783 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:07.654848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:07.658372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.658828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.659635 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.660250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.684797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:07.685498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:07.692781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.693237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.694043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:07.694479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:07.843524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:07.852175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:07.854040 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d941096c-4547-4217-ac8a-c0ad00b00b03 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.207121 Jan 28 08:08:07.854880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 192/369] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:07 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:07.859530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6bbe9634-ab6f-4afd-9488-52937d290879 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.178701 Jan 28 08:08:07.860274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 178/370] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:07 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:08.187964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:08.188901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:08.195221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.195699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.196466 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.196900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.268008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d524b629-81bc-41c9-97b6-90bc1ef68d9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.083641 Jan 28 08:08:08.268687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 193/371] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:08 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:08.386326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:08.389132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:08.401272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.402454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.409903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.410533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.490990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e07a2c95-5d3f-474b-b804-565fd0e701f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.109401 Jan 28 08:08:08.491750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 179/372] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:08 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:08.875175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:08.875953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:08.876756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:08.877478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:08.883846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.884239 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.884917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.885024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.885363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.885463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:08.886167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:08.886777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:09.024350 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:09.027773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:09.036344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d5a21f88-c94d-4efa-9585-6ba24d341081 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.163713 Jan 28 08:08:09.037017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 180/373] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:08 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:09.052852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b50df02e-38a8-4c19-b561-b7bbb888f855 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.182711 Jan 28 08:08:09.054149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 194/374] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:08 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:09.280609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:09.281437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:09.288921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:09.289450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:09.290334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:09.290694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:09.370474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2067c262-c79d-4ed0-ae90-00b838d7ea08 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28217 microversion: 2.20 time: 0.093603 Jan 28 08:08:09.371155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 181/375] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:09 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:09.501494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:09.502715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:09.508769 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:09.509212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:09.509982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:09.510907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:09.591569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-af424295-8b5a-491a-b6e7-f5c9bead78ef tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.093436 Jan 28 08:08:09.592236 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 195/376] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:09 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:10.054205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:10.054919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:10.061702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.062147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.062918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.063386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.070089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:10.076516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:10.077675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.078059 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.078936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.079372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.219797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:10.219963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:10.228264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-17a4217e-5897-4f3b-bcc4-aae83eb4a249 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.162228 Jan 28 08:08:10.228843 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 196/377] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:10 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:10.236300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-98df7615-0eb9-4887-b650-358163a6bfc6 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.186558 Jan 28 08:08:10.237116 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 182/378] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:10 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:10.382505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:10.383511 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:10.389707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.390156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.390922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.391389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.493500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-32b7df73-7fa2-4cf5-8732-e8a46bf69ae6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28242 microversion: 2.20 time: 0.115082 Jan 28 08:08:10.494146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 197/379] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:10 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:10.604055 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:10.605036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:10.611502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.611960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.613339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:10.613786 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:10.679928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cd2a49e2-42e0-41dd-a4ab-eb83f9b5d369 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28184 microversion: 2.1 time: 0.079303 Jan 28 08:08:10.680571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 183/380] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:10 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:11.244706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:11.249756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:11.252328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.252783 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.254061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.254312 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:11.254708 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.255021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:11.261789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.262265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.263037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.263499 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.387825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:11.392146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:11.396231 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-459249ac-9fd6-4b23-a0f5-c5e181a1b7ae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.155577 Jan 28 08:08:11.396865 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 198/381] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:11 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:11.400533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ddaefe81-bb69-491c-8ab1-3976232b6f7b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.150697 Jan 28 08:08:11.401165 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 184/382] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:11 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:11.505853 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:11.506853 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:11.513921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.514333 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.515159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.515632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.599080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c5a510e2-cae2-420e-8b93-d08e90c189d6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28508 microversion: 2.20 time: 0.097156 Jan 28 08:08:11.600060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 199/383] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:11 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28508 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:11.692003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:11.692928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:11.699141 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.699617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.700380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:11.700809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:11.777620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-778247f6-3cb1-477d-a1d5-fc50ae108d35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28473 microversion: 2.1 time: 0.089685 Jan 28 08:08:11.778248 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 185/384] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:11 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28473 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:12.414151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:12.414858 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:12.417681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:12.418382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:12.422129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.422580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.423390 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.423825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.425276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.425759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.426534 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.426967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.563942 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:12.572572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:12.573475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a0ba218e-86ce-4b24-98f8-e5cab152dcbe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.164053 Jan 28 08:08:12.583906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 200/385] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:12 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:12.584086 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-011ef4f4-3723-4283-ab82-41f84ca83295 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.166965 Jan 28 08:08:12.590402 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 186/386] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:12 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:12.610221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:12.611227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:12.617211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.617772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.618569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.619011 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.628755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-e88e5d83-9f6a-4c7f-b2a4-2790720b0710 req-9c9a05fc-2e0b-479c-80e2-835e14e92b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85aa54d-ba74-47b8-9b76-f6e864410c3f", "name": "network-vif-plugged", "status": "completed", "tag": "c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:12.630334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:12.630334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:08:12.637193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-e88e5d83-9f6a-4c7f-b2a4-2790720b0710 req-9c9a05fc-2e0b-479c-80e2-835e14e92b7d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.637646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-e88e5d83-9f6a-4c7f-b2a4-2790720b0710 req-9c9a05fc-2e0b-479c-80e2-835e14e92b7d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.649114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-e88e5d83-9f6a-4c7f-b2a4-2790720b0710 req-9c9a05fc-2e0b-479c-80e2-835e14e92b7d service nova] Creating event network-vif-plugged:c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1 for instance c85aa54d-ba74-47b8-9b76-f6e864410c3f on hv-cinder-80403 Jan 28 08:08:12.653837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-e88e5d83-9f6a-4c7f-b2a4-2790720b0710 req-9c9a05fc-2e0b-479c-80e2-835e14e92b7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 Jan 28 08:08:12.654419 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 187/387] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:08:12.708960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2a1d1ded-a473-4bcc-9856-a478a04f76cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28508 microversion: 2.20 time: 0.102147 Jan 28 08:08:12.709988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 201/388] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:12 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28508 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:12.790014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:12.791006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:12.797459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.797913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.798739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:12.799184 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:12.899667 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5dccf2bc-f645-47da-96c1-8c455b8c90ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28475 microversion: 2.1 time: 0.113840 Jan 28 08:08:12.900488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 188/389] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:12 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28475 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:13.590836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:13.591567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:13.596894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:13.602755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:13.602872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.602872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.602872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.602872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.604826 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.605282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.606073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.606510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.741307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:13.746504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:13.753085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-606f2d2f-2190-4b1c-bdc6-63b05956a9d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.166095 Jan 28 08:08:13.754392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 202/390] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:13 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:13.756325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a2863e81-9d03-4eed-81c1-1ed89bc84a8e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.163070 Jan 28 08:08:13.760713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:13.762244 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:13.765790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 189/391] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:13 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:13.768800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.769297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.770238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.770884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.857940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bba5638b-57b7-4918-975d-a1bef0acf842 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.102059 Jan 28 08:08:13.858608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 203/392] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:13 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:13.911445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:13.912361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:13.918897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.919383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:13.920159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:13.920594 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.033993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-57ee4e76-8c30-4e5f-abe8-f2ee6038ca5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28600 microversion: 2.1 time: 0.126511 Jan 28 08:08:14.035203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 190/393] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:13 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28600 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:14.771113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:14.771837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:14.772886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:14.773603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:14.778748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.779210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.780007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.780439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.780639 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.781124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.781969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.782410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.913787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:14.917947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:14.922339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4151a153-b0fe-4660-a457-5427c96645b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.155316 Jan 28 08:08:14.927423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 204/394] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:14 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:14.928111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:14.929118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:14.933878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e05edd88-f250-40ea-b62e-a3809f4253f5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1317 microversion: 2.1 time: 0.164915 Jan 28 08:08:14.934551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 191/395] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:14 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:14.934776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.935233 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:14.936051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:14.936486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.046260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:15.047201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:15.054001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.054452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.055220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.055754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.154186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bda40f3e-8fef-4c5a-a000-4a5e751780c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.224432 Jan 28 08:08:15.154186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 205/396] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:14 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:15.206560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2d184bb8-5c9f-47bf-858d-c7f14668eb38 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.163767 Jan 28 08:08:15.207197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 192/397] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:15 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:15.939934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:15.940749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:15.949025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.949580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.950562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.951097 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.953942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:15.954666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:15.963209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.963930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:15.965467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:15.965936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:16.102534 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:16.112208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-81140d6b-1332-40d7-8b18-7c810a3df15f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.175688 Jan 28 08:08:16.112803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 206/398] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:15 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:16.157851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:16.163051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:16.164041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:16.164916 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d4e4eec9-27a6-422a-8746-4379c7fd927c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1508 microversion: 2.1 time: 0.217497 Jan 28 08:08:16.165438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 193/399] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:15 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:16.170086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:16.170605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:16.171482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:16.171978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:16.218192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:16.219260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:16.225646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:16.226403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:16.227195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:16.227733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:16.245321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fb618e6f-4046-4c72-b500-2ca44d839647 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.085607 Jan 28 08:08:16.245984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 207/400] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:16 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:16.412074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8dad43ea-e5d9-4064-a518-3282842cb744 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.197434 Jan 28 08:08:16.412823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 194/401] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:16 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:17.130610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:17.131463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:17.138370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.138816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.139636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.140066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.257869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:17.258790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:17.265591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.266046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.266555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:17.266833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.267293 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.274622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1fc28437-9e25-450b-b0ca-49c308798ea6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.148575 Jan 28 08:08:17.283438 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 208/402] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:17 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:17.423546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:17.424491 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:17.431394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.431904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.434211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:17.434669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:17.468248 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3c5302a1-ed12-4e9a-ae00-ddc21b745776 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.214327 Jan 28 08:08:17.468903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 195/403] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:17 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:17.551963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bbb84f37-55bf-4554-9500-5af2b3849073 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.131662 Jan 28 08:08:17.553232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 209/404] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:17 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:18.292720 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:18.293410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:18.300246 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.300692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.301508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.302655 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.429721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:18.437511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7e0da9f9-1ef0-4ead-9987-c011809e80aa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.148984 Jan 28 08:08:18.438082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 196/405] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:18 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:18.480482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:18.482155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:18.488957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.489917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.490692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.491120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.563707 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:18.564623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:18.565810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c8b086ba-cbac-4249-865a-4b3856392414 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.089226 Jan 28 08:08:18.566452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 210/406] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:18 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:18.571605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.572052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.572857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:18.573289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:18.665540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8a5a6380-72d9-4319-94f7-aa4e042f1da0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.105683 Jan 28 08:08:18.666182 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 197/407] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:18 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:19.002399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ddccf5e-dbda-4113-9841-2c606ded0632"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:19.003769 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.012090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.012540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.013317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.013913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.454147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:19.454837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.462185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.462556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.463404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.463845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.600372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:19.607478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4fe57e99-d3e4-44dc-a89c-e540f2173eaa tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1500 microversion: 2.1 time: 0.157341 Jan 28 08:08:19.608045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 198/408] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:19 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:19.612772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:19.618454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.621119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.621568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.622342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.622771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.688167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-52b92418-d99c-401a-975f-065ea887ec1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.078888 Jan 28 08:08:19.689212 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 199/409] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:19 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:19.694594 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8890a8bd-ade1-4e12-90a6-2cecd2cae3ca"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:19.695820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.702894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.703378 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.704173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.704614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.729661 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] HTTP exception thrown: Cannot 'attach_volume' instance d4e823ff-de17-4756-8990-8c2cdc9bd349 while it is in vm_state rescued Jan 28 08:08:19.730358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Returning 409 to user: Cannot 'attach_volume' instance d4e823ff-de17-4756-8990-8c2cdc9bd349 while it is in vm_state rescued {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:08:19.731237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-65a69c07-f054-4d2d-816b-19402b7a98cb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040815 Jan 28 08:08:19.731810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 200/410] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:08:19 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 08:08:19.736395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:19.737291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.746250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.746706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.747593 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.748038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.782814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-86bb9b69-9d98-4764-a35c-383f80036566 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784418 Jan 28 08:08:19.783571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 211/411] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:08:18 2022] POST /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:19.789094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:19.789592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:19.796595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.797056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.797846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:19.798281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:19.812182 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c2b05cf1-1f8e-45fb-b1ba-940e6e88eac6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.078927 Jan 28 08:08:19.814069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 201/412] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:19 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:20.021783 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3ecf9916-faa7-4dbc-b4bb-d6393ef32b55 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action" status: 202 len: 0 microversion: 2.1 time: 0.236793 Jan 28 08:08:20.022417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 212/413] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:19 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:20.030932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:20.031665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:20.038621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.039061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.039878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.040316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.219041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:20.226940 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b00b2efd-ec0d-4de4-815d-c4ca30b10f26 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1508 microversion: 2.1 time: 0.200006 Jan 28 08:08:20.227738 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 202/414] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:20 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:20.701156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:20.702319 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:20.713317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.713317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.716176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.716627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.826113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:20.827064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:20.834221 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.834445 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2b0a1023-f20e-4f80-8bf7-501de7a975cc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.137743 Jan 28 08:08:20.834883 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.835609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:20.836047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:20.844814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 213/415] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:20 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:20.918033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-805ff81a-e066-4674-8bbe-7497ea05055c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.095440 Jan 28 08:08:20.918746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 203/416] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:20 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:21.244647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:21.245341 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:21.252157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.252611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:21.253379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.253807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:21.386064 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:21.394278 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cd4d2248-5a96-4e37-b74a-670f4b23a098 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1508 microversion: 2.1 time: 0.154212 Jan 28 08:08:21.396489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:21 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:21.847070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:21.848363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:21.855315 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.855770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:21.856617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.857062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:21.929640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:21.945321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:21.945321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.945321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:21.945901 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-df720900-1d84-4472-ad9c-62ae48fb2568 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.094690 Jan 28 08:08:21.946002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:21.946091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 204/418] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:21 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:21.946173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:22.007294 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6bc1d15d-d5f4-400f-8992-5901c9b93b89 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.081188 Jan 28 08:08:22.011283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 215/419] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:21 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:22.413350 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:22.414046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:22.421445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:22.421820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:22.422608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:22.423039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:22.556938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:22.564215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e2a4ad2f-f3a6-47cb-b0ab-c364c07ae070 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1508 microversion: 2.1 time: 0.155465 Jan 28 08:08:22.572379 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 205/420] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:22 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:22.950678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:22.951704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:22.958558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:22.959378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:22.960192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:22.960597 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:23.019195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:23.020175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:23.027030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:23.027519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:23.028320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:23.028751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:23.117130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ed162e67-377f-4f63-b2e9-5db0c25f10db tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.170542 Jan 28 08:08:23.117791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 216/421] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:22 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:23.179667 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b6475cc2-316f-4e7a-a6da-12d516459984 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.163996 Jan 28 08:08:23.180356 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 206/422] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:23 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:23.582176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:23.582852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:23.590164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:23.590647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:23.591459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:23.591890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:23.717157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:23.725484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-99176340-43c5-48d8-878f-5782652f4c14 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1508 microversion: 2.1 time: 0.147454 Jan 28 08:08:23.726046 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 217/423] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:23 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:24.129390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:24.131086 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:24.138008 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.138451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.139223 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.139670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.191138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:24.192113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:24.199054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.199501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.200313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.200749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.210461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-80ed66eb-1cd2-4f54-bd23-1f6eb1a30cfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.083007 Jan 28 08:08:24.212909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 207/424] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:24 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:24.328614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-59eb98e2-9cd6-40fa-81ac-249170556ada tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.141207 Jan 28 08:08:24.330548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 218/425] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:24 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:24.743109 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:24.743852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:24.750982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.751460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.752244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:24.752683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:24.878343 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:24.885713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e6643c43-3267-4f44-af24-b4aaf1c20be9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1514 microversion: 2.1 time: 0.147395 Jan 28 08:08:24.886279 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 208/426] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:24 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:25.222563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:25.223633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:25.230470 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:25.230921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:25.231798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:25.232230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:25.299690 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3b103faf-1b78-498f-9b5b-2ef56ee54e16 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.080932 Jan 28 08:08:25.300771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 219/427] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:25 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:25.343332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:25.353827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:25.353827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:25.354031 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:25.355913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:25.356383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:25.422087 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7285b84f-2a93-462d-9d73-d5f3a5a3146e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.082384 Jan 28 08:08:25.422731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 209/428] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:25 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:26.312838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:26.314283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:26.321500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:26.321954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:26.322758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:26.323183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:26.434138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:26.435059 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:26.441933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:26.442877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:26.443492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-68b77c39-9415-4ae3-b40f-78e488313e49 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.134629 Jan 28 08:08:26.443755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:26.446728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 220/429] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:26 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:26.446871 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:26.522138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b80f02d7-48cc-4817-be10-af71370ab280 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.091867 Jan 28 08:08:26.523300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 210/430] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:26 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:27.455839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:27.456807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:27.463845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.464295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.465073 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.465505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.531467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2d4274d8-88a8-4100-a443-b4f44240d435 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.079578 Jan 28 08:08:27.532449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 221/431] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:27 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:27.534430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:27.535550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:27.542781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.543236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.544042 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.544474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.621300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e49552e4-b3b8-4807-86a8-fca0e4a434ac tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.090879 Jan 28 08:08:27.621947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 211/432] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:27 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:27.676924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:27.677723 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:27.684844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.685292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.686109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.686575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.818849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:27.826993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-aa0de1f0-df30-423e-b647-e412afc55106 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1514 microversion: 2.1 time: 0.154109 Jan 28 08:08:27.827596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 222/433] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:27 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:27.844869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7593db37-6dc5-424f-b9a1-353fea5c1b6b"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:27.846057 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:27.853113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.853614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:27.854403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:27.854843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.344376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ddccf5e-dbda-4113-9841-2c606ded0632"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:28.345527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:28.352484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.352939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.353710 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.354150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.432424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Invalid volume: volume 1ddccf5e-dbda-4113-9841-2c606ded0632 is already attached to instances: c85aa54d-ba74-47b8-9b76-f6e864410c3f Jan 28 08:08:28.433260 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 400 to user: Invalid volume: volume 1ddccf5e-dbda-4113-9841-2c606ded0632 is already attached to instances: c85aa54d-ba74-47b8-9b76-f6e864410c3f {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:08:28.434254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a31b616b-5b69-420e-8cb3-4d3aadd83f72 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093760 Jan 28 08:08:28.434999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 223/434] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:08:28 2022] POST /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:08:28.492592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:28.493149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:28.499052 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.499537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.500326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.500764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.578476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lazy-loading 'services' on Instance uuid c85aa54d-ba74-47b8-9b76-f6e864410c3f {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:08:28.639752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5a70e6fd-8d7c-46db-b371-c90006c19595 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798895 Jan 28 08:08:28.640239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 212/435] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:08:27 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:28.645424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:28.646953 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:28.654207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.654657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.655472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.656214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.723789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aa02a900-1057-4f06-8746-9005176f9f98 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.082151 Jan 28 08:08:28.724503 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 213/436] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:28 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:28.729337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:28.730303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:28.737061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.737506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.738268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.738696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.811265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6d2858ef-5b7a-4ea6-a41e-66600ade7d58 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.085367 Jan 28 08:08:28.815292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 214/437] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:28 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:28.900508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a302d0b2-a4a9-433d-9805-9163d71dcea5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments/1ddccf5e-dbda-4113-9841-2c606ded0632" status: 202 len: 0 microversion: 2.1 time: 0.408702 Jan 28 08:08:28.900508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 224/438] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:08:28 2022] DELETE /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments/1ddccf5e-dbda-4113-9841-2c606ded0632 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:28.906747 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:28.907849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:28.914574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.915020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.915835 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:28.916534 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:28.951691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5af8e898-54a0-4405-9590-835ac0a0df46 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049024 Jan 28 08:08:28.952522 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 215/439] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:28 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:29.736060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:29.737327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:29.744469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.745002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:29.745811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.746251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:29.823525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:29.825157 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:29.828096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-51af08dd-1b5b-43f6-ab49-ff267e888e8f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.096109 Jan 28 08:08:29.828793 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 225/440] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:29 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:29.832168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.832622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:29.833944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.834381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:29.903672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-099d99b9-4c52-4fe6-9163-a74a1c855773 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.083663 Jan 28 08:08:29.904584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 216/441] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:29 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:29.964226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:29.965226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:29.972030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.972475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:29.973240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:29.974304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:30.003541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a09bf70e-76a1-45ca-a205-d18a88d23e9a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Jan 28 08:08:30.004099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 226/442] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:29 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:30.840209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:30.841195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:30.847976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:30.848939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:30.849709 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:30.850138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:30.915626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:30.916893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:30.922987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d0390602-2df7-488a-9b95-7e02cfe6e7b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.086623 Jan 28 08:08:30.923616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:30.927789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 217/443] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:30 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:30.927950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:30.927950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:30.927950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:30.995418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f19fec96-b1fe-45ee-8c13-57bd68124fb7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.083840 Jan 28 08:08:30.996050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 227/444] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:30 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:31.015844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:31.016821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:31.023842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:31.024295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:31.025076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:31.025514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:31.055772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ad4ffe89-8a96-4a3b-aef7-bb47d05ea61f tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Jan 28 08:08:31.056326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 218/445] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:31 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:31.936143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:31.937142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:31.944540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:31.944991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:31.945777 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:31.946212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:32.007507 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:32.008414 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:32.014995 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4183f23e-2462-47cc-b466-9e6a0280c3a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.082704 Jan 28 08:08:32.015549 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:32.015750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 228/446] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:31 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:32.015999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:32.016895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:32.017332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:32.068201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:32.069213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:32.076058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:32.076509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:32.077282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:32.077713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:32.084790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ada450e7-d3bb-4faf-9209-cef74f55c908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.081376 Jan 28 08:08:32.085454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 219/447] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:32 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:32.108967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2436b342-3afd-45c8-82f1-dd35dda9c429 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Jan 28 08:08:32.109529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 229/448] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:32 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:08:33.027108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:33.028284 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:33.034840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.035387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.036219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.036650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.096462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:33.102945 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:33.103090 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1b3b4967-213a-4297-b0d0-01634b0170a9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.079762 Jan 28 08:08:33.103684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.103789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 220/449] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:33 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:33.104135 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.104918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.105351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.119893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:33.121006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:33.128114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.128663 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.131546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:33.131546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:33.161805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b95fcfe7-81c2-41ae-9a40-6c032f52935a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Jan 28 08:08:33.162914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 221/450] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:33 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:33.168699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ea75bb9e-b292-406e-bfa1-bf29c480f9cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.075840 Jan 28 08:08:33.169339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 230/451] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:33 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:34.114505 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:34.115461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:34.121580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.122022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.122780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.123210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.173782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:34.174926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:34.182001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.182380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.183159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.183651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.186989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6b12ed89-3f5e-416f-a1d2-4b11d510a255 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.075872 Jan 28 08:08:34.188208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 222/452] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:34 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:34.193083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:34.194139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:34.201355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.201816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.202802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:34.203037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:34.215565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c65cd8b3-91e9-43d7-b437-db23706c0ca4 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 Jan 28 08:08:34.216156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 231/453] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:34 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:08:34.273638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5144d266-6ca8-4ca8-a823-2afa7835c812 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.080842 Jan 28 08:08:34.276374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 223/454] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:34 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:35.198037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:35.198997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:35.205890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.206291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.207080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.207549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.235997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:35.236984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:35.244022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.244471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.245264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.245680 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.275763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f9395981-0843-4261-925a-cc797803a041 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Jan 28 08:08:35.276318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 224/455] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:35 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:08:35.285903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:35.286870 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:35.293633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.294117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.294921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:35.295437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:35.418352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5a080d16-347b-4d16-8388-81c9cec1e2de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.223782 Jan 28 08:08:35.419015 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 232/456] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:35 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:35.428401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-dcd55cb3-dfd6-464f-b707-9cb7346ec7d0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.146035 Jan 28 08:08:35.429040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 225/457] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:35 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:36.287968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:36.288984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:36.296955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.297432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.299446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.299446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.332409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c48f85e7-70a8-41a1-9728-caa6fcec0df1 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049315 Jan 28 08:08:36.333506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 233/458] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:36 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:36.430602 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:36.431653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:36.438978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.439714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.440432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:36.440605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.440929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.441829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:36.448373 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.449016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.449909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:36.450455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:36.524396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-dd930905-dcb1-41cd-a4e2-c8b27eb45bb3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.097683 Jan 28 08:08:36.525395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 226/459] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:36 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:36.537602 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1d5186f5-986f-453a-b46c-b9de065362f6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.100926 Jan 28 08:08:36.538451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 234/460] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:36 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:37.161628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:37.162770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:37.170457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.170999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.173319 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.173319 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.197914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'flavor' on Instance uuid d4e823ff-de17-4756-8990-8c2cdc9bd349 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:08:37.344031 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:37.345016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:37.351911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.360392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.360392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.360392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.382997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a4404ad8-8ab0-4ef3-af27-890545b82fbf tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jan 28 08:08:37.383580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 235/461] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:37 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:08:37.535621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:37.537101 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:37.543924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.544376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.545192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.545624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.644910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a6e343b2-3a65-437b-b49c-aa0f0a67d7c3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.112830 Jan 28 08:08:37.649934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 236/462] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:37 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:37.651491 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:37.652481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:37.659491 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.659947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.660752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:37.661170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:37.747614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e153d15a-d139-4eb9-b5f0-8590513e13b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.100114 Jan 28 08:08:37.748249 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 237/463] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:37 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:37.983018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e6ef7185-71ca-4454-ba75-31709f804e1d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action" status: 200 len: 32 microversion: 2.1 time: 0.825764 Jan 28 08:08:37.983826 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 227/464] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:37 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action => generated 32 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:08:37.996993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:37.997697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:38.005408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.005994 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.006647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.007086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.144575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:38.152685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c3389dd9-1fff-489c-b917-9e1b6a0361c4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.159676 Jan 28 08:08:38.153264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 238/465] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:37 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:38.394633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:38.396230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:38.402933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.403425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.404220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.404658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.433716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5c397bca-a6a3-4c23-a8cb-843a4d0254b7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043682 Jan 28 08:08:38.434292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 228/466] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:08:38 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:08:38.582363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914515072", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "b961ad58-0562-480d-9a8e-4d9280c8a5d0"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:38.633747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] validate_networks() for [('b961ad58-0562-480d-9a8e-4d9280c8a5d0', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:08:38.657198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:38.658106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:38.667093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.667580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.668449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.668894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.751054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4cd6f4fe-e409-4fe0-b5ba-269e710b1651 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.097350 Jan 28 08:08:38.755685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 229/467] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:38 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:38.759656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:38.760651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:38.767460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.767907 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.768683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:38.769126 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:38.843436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c241fc11-2449-40a7-a454-7a868c1cfc35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.087329 Jan 28 08:08:38.847381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 230/468] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:38 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:38.992998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:08:38.993479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:08:38.993911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:08:38.994352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:08:38.994767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:08:39.003364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.003817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.004657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.005098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.020955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:08:39.024858 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Getting quotas for user cf2c7ab19f374ad39a5c0f21e4e24835 and project a7d20a5061d447d29c55be6fddbd3b8f. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:08:39.035521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:08:39.038329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:08:39.170329 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:39.171018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:39.178318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.178760 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.179557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.179987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.197301 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f1b38bec-c99d-4f16-b6d6-91dca9b94632 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618555 Jan 28 08:08:39.198274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 239/469] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 08:08:39.207684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1ef03baa-298c-4f75-aa25-d7d00b0012b8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:39.208338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1ef03baa-298c-4f75-aa25-d7d00b0012b8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:39.262800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1ef03baa-298c-4f75-aa25-d7d00b0012b8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:39.271929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1ef03baa-298c-4f75-aa25-d7d00b0012b8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1217 microversion: 2.1 time: 0.065413 Jan 28 08:08:39.278765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 240/470] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:39 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:39.334187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:39.339698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b10c45ee-32bd-4b1b-a8c3-572dd9dc561f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.173608 Jan 28 08:08:39.340265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 231/471] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:39 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:39.763481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:39.764506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:39.771274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.771741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.772512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.772947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.843314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ae7590d3-2813-49d0-9f07-aa9b85472f77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.083512 Jan 28 08:08:39.843972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 241/472] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:39 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:39.854944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:39.855882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:39.862048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.862493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.863275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:39.863705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:39.932589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-acd1195d-1b68-4007-b370-2bbf00ddb410 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.081135 Jan 28 08:08:39.933231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 232/473] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:39 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:40.172853 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-312165586", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "7cff128e-ba62-4803-9f9b-57d2ce420c02"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:40.223770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] validate_networks() for [('7cff128e-ba62-4803-9f9b-57d2ce420c02', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:08:40.286267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:40.286969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:40.293995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.294689 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.295509 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.295956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.361955 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:40.370463 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ff2e5333-39e7-41c7-8df2-0ae819a10efb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1221 microversion: 2.1 time: 0.088122 Jan 28 08:08:40.371042 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 233/474] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:40 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:40.375505 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:40.376131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:40.383144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.388363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.388363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.388363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.516975 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:40.525766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8cc41ea9-d3ee-4857-ab25-b24d522df016 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.153476 Jan 28 08:08:40.526438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 234/475] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:40 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:40.584543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:08:40.584972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:08:40.585450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:08:40.585860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:08:40.586278 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:08:40.595022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.595466 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.596279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.596717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.613309 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Getting quotas for project b4caadfc3fd847008ba57fe5fc8d82a5. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:08:40.617232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Getting quotas for user 8b1922f9b5df450b88e0183cb6dc1419 and project b4caadfc3fd847008ba57fe5fc8d82a5. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:08:40.628018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:08:40.630988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:08:40.745456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-77cb9eed-5e57-4135-bcf0-c0a5b13cc4f2 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576623 Jan 28 08:08:40.746100 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 242/476] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:08:40.756396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-03ebbc95-1529-4f8f-af02-8d692b1cbec0 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:40.756979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-03ebbc95-1529-4f8f-af02-8d692b1cbec0 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:40.809066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-03ebbc95-1529-4f8f-af02-8d692b1cbec0 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:40.815733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-03ebbc95-1529-4f8f-af02-8d692b1cbec0 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1218 microversion: 2.1 time: 0.063469 Jan 28 08:08:40.816539 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 235/477] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:40 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:40.855004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:40.856151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:40.862529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.862963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.864370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.864817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.934326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a67acdc7-874f-4635-9a36-94f43029e36c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.083013 Jan 28 08:08:40.935207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 243/478] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:40 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:40.944013 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:40.944981 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:40.951596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.952046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:40.952866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:40.953302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.021015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-693ed786-e5ee-46ae-98f6-38535984f564 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.080500 Jan 28 08:08:41.021675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 236/479] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:40 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:41.387470 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:41.388180 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:41.396893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.397562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.399212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.400023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.469202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:41.477494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8d15a64b-b8e4-473a-bb62-d40f3f072c86 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1277 microversion: 2.1 time: 0.094018 Jan 28 08:08:41.478080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 244/480] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:41 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:41.542929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:41.543706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:41.550636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.551093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.551931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.552370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.776832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:41.785185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-efb10109-a0d3-4123-9152-f88a06bd37bd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.246640 Jan 28 08:08:41.786039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 237/481] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:41 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:41.832980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:41.833820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:41.840296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.840830 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.841684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.842187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.902447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:41.909947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-01cc717b-211c-4e9e-a290-483e54ed5730 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1222 microversion: 2.1 time: 0.080593 Jan 28 08:08:41.910538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 245/482] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:41 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:41.945218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:41.946054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:41.952233 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.952685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:41.953455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:41.953891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.018463 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-53621b19-104c-443b-a33a-20d7fa49f430 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.076934 Jan 28 08:08:42.019210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 238/483] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:41 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:42.031744 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:42.032709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:42.038949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.039511 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.040280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.040713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.122290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c6b6ff6f-944c-4f0e-aea1-54aab19f45f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.094084 Jan 28 08:08:42.123513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 246/484] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:42 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:42.494741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:42.495420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:42.502352 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.502797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.503609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.504037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.701967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:42.709188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3b9e9924-ffe2-4f59-ae7c-6051bd918661 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.218528 Jan 28 08:08:42.709750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 239/485] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:42 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:42.802747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:42.803471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:42.810324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.810896 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.811551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.811998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.928425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:42.929314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:42.936856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.937322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.938108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:42.939342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:42.958209 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:42.968676 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-12919b14-5b77-470c-988a-2919f0ca6186 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.170447 Jan 28 08:08:42.971310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 247/486] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:42 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:43.019833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:43.027094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1e423ffa-a7fa-4a2f-8db2-9ca1c0a5755e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1270 microversion: 2.1 time: 0.103057 Jan 28 08:08:43.027685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 240/487] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:42 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:43.029851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:43.030938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:43.037934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.045223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.045223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.045223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.115665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dd4eb22b-e1de-4967-8121-25186dc88c9b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.089303 Jan 28 08:08:43.116324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 248/488] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:43 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:43.135388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:43.136662 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:43.141585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-ee79d759-a885-4101-9359-6cf23bfcc4e1 req-c52f2ac4-edce-41fc-a582-196ba202aab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64f412d-6440-4287-85f8-ce4bee9d3a7b", "tag": "a9af858f-2b7c-47b5-b571-4c23a99fb8ac"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:43.142823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.143560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.143892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:43.143892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:08:43.144397 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.144865 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.154628 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ee79d759-a885-4101-9359-6cf23bfcc4e1 req-c52f2ac4-edce-41fc-a582-196ba202aab2 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.154980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ee79d759-a885-4101-9359-6cf23bfcc4e1 req-c52f2ac4-edce-41fc-a582-196ba202aab2 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.168470 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-ee79d759-a885-4101-9359-6cf23bfcc4e1 req-c52f2ac4-edce-41fc-a582-196ba202aab2 service nova] Creating event network-changed:a9af858f-2b7c-47b5-b571-4c23a99fb8ac for instance f64f412d-6440-4287-85f8-ce4bee9d3a7b on hv-cinder-80403 Jan 28 08:08:43.173121 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-ee79d759-a885-4101-9359-6cf23bfcc4e1 req-c52f2ac4-edce-41fc-a582-196ba202aab2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 Jan 28 08:08:43.173719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 249/489] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:43.259623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-33e5f9a1-bd4f-403b-a611-cc9b91902066 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.128340 Jan 28 08:08:43.260535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 241/490] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:43 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:43.739215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:43.742579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:43.747486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.748021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.748884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.749392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.987541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:43.988539 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:43.996617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.997222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:43.998254 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:43.998682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.018155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:44.029388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1e3406b7-f184-4a93-97b4-6a40046af80c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.294124 Jan 28 08:08:44.030307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 250/491] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:43 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:44.053763 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:44.055579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:44.059803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.060252 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.061160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.061597 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.141098 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:44.155701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-66e46af2-5047-4f56-afc9-42157fd5ef4d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.167341 Jan 28 08:08:44.155701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 242/492] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:43 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:44.155701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:44.156264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:44.164683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.165327 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.166391 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.166980 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.240450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-17c7c0ce-1eec-4712-8719-0a85569c6148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.088821 Jan 28 08:08:44.241485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 243/493] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:44 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:44.274275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:44.275544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:44.283159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.283771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.284617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:44.285169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:44.368082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:44.375502 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-737dfedc-f936-4a59-a9fd-b7c52b41607d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.326405 Jan 28 08:08:44.376279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 251/494] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:44 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:44.691178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cb446586-27fd-4882-8953-3353df1eb7de tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.422553 Jan 28 08:08:44.695703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 244/495] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:44 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:45.045880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:45.046493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:45.053327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.053782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.054565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.054995 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.168656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:45.169609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:45.177393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.178047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.178933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.179546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.183813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:45.192286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-81a9cb36-460e-4e04-b8e1-3b64d95fef0b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.149071 Jan 28 08:08:45.192286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 252/496] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:45 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:45.216386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-b3211c61-efaa-4415-aba7-a9e96aef95f1 req-3c6ea6f8-d258-46e5-9744-4a25957a84aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3c2928-f7b0-4653-af54-0f776c2cd0b1", "tag": "0e912ecb-28e4-404c-b81f-04816b4beb29"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:45.218185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:45.218185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:08:45.225969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-b3211c61-efaa-4415-aba7-a9e96aef95f1 req-3c6ea6f8-d258-46e5-9744-4a25957a84aa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.226415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-b3211c61-efaa-4415-aba7-a9e96aef95f1 req-3c6ea6f8-d258-46e5-9744-4a25957a84aa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.239458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-b3211c61-efaa-4415-aba7-a9e96aef95f1 req-3c6ea6f8-d258-46e5-9744-4a25957a84aa service nova] Creating event network-changed:0e912ecb-28e4-404c-b81f-04816b4beb29 for instance 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 on hv-cinder-80403 Jan 28 08:08:45.244127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-b3211c61-efaa-4415-aba7-a9e96aef95f1 req-3c6ea6f8-d258-46e5-9744-4a25957a84aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031256 Jan 28 08:08:45.244904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 253/497] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:45.252178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:45.253149 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:45.259761 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.260213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.261036 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.261475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.334569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-21ca83b5-21ae-409b-b191-84df9c8d353c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.086007 Jan 28 08:08:45.338583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 254/498] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:45 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:45.393608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:45.394302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:45.402380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.402832 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.403642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.403793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:45.404084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.412388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d3fe56a8-afe8-4013-9c2b-7af399dfc6b7 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.248382 Jan 28 08:08:45.413094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 245/499] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:45 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:45.540380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:45.547962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4c565629-042a-493b-9563-3de0efe2382d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.158333 Jan 28 08:08:45.548892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 255/500] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:45 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:45.702816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:45.703780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:45.710956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.711440 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.712217 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:45.712682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:45.984831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-42073a95-af4e-42bb-9c39-b12b6593af14 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.285539 Jan 28 08:08:45.985743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 246/501] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:45 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:46.207918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:46.208483 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:46.214693 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.215147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.215980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.216412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.342525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:46.346466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:46.349705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:46.350691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c3873e8e-fea3-471f-a757-4ef08e87a13a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.146992 Jan 28 08:08:46.351286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 256/502] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:46 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:46.354869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.355352 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.356127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.356558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.428990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a641c903-872e-44bc-b3b0-ba1b026ca6c8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.086380 Jan 28 08:08:46.429465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:46.429616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 247/503] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:46 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:46.430073 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:46.435963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.436408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.437173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.437601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.564018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:46.565590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:46.566287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:46.572446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c1915a5b-9021-4fff-93c4-9580a5e281c8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.146520 Jan 28 08:08:46.573021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 257/504] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:46 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:46.573584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.574040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.574818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:46.575278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:46.706360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:46.714592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b6e88e77-1b02-4c9c-b0e1-6a382b723767 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.153160 Jan 28 08:08:46.715163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 248/505] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:46 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:46.997007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:46.997975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:47.004931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.005404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.006211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.006654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.069352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f119907b-ec73-4729-931e-f332205c34ae tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.075839 Jan 28 08:08:47.069968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 258/506] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:46 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:47.367390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:47.368000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:47.374263 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.374708 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.375493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.375921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.441439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:47.443086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:47.452727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.453186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.453984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.454425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.506526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:47.514062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5d23a34e-e7f4-44af-9517-e12828beda99 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.150436 Jan 28 08:08:47.514652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 249/507] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:47 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:47.551488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14d72077-5bac-4ba1-9717-7701486ceb11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.113778 Jan 28 08:08:47.552167 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 259/508] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:47 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:47.589368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:47.589922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:47.595877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.596328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.597101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.597540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.727688 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:47.731391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:47.732084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:47.734069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1cbad82a-46e0-4c57-ba2c-cb87a9681e2c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.148308 Jan 28 08:08:47.736365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 250/509] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:47 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:47.741184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.741629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.742415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:47.742848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:47.869105 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:47.876299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c99216a6-61a7-48ca-b6fe-67ccdb8da6a3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.148949 Jan 28 08:08:47.876855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 260/510] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:47 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:48.080781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:48.081754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:48.087737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.088192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.088971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.089418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.163763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-33958811-3997-4d9d-8483-45a20a07f44d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.086473 Jan 28 08:08:48.164311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 251/511] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:48 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:48.531283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:48.531839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:48.538734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.539183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.539992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.540430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.563452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:48.564449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:48.571194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.571677 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.572441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.572871 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.643566 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3f6711d4-db0d-4ec0-ad1e-9307d2534148 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.083862 Jan 28 08:08:48.644645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 252/512] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:48 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:48.669873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:48.677454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-70608267-d03c-4a89-b613-b39a678da7dd tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.149881 Jan 28 08:08:48.678062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 261/513] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:48 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:48.751911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:48.752752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:48.760026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.760481 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.761256 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.761692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.889373 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:48.893365 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:48.896286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:48.899279 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5e67f1af-1d7f-458f-82bb-c8d0c0bb5670 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.150856 Jan 28 08:08:48.900200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 253/514] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:48 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:48.900937 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.901396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:48.902208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:48.902640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.036150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:49.044996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3545984a-ae3d-4844-b7f6-0ed61e03bb66 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.155238 Jan 28 08:08:49.045913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 262/515] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:48 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:49.174779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:49.175748 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:49.182429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.182835 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.183636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.184072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.328557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7b6954f8-b0b1-4990-9f8c-22472db3d618 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.157303 Jan 28 08:08:49.329902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 254/516] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:49 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:49.655574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:49.656412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:49.662581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.663023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.663808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.664239 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.695271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:49.695970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:49.706791 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.707234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.708628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.709063 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.789381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ec36d774-8702-42dc-a165-760b84ce94fe tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.137421 Jan 28 08:08:49.794528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 263/517] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:49 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:49.834268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:49.841359 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ec95b955-8416-451b-bc74-9a66860a737b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.150674 Jan 28 08:08:49.841923 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 255/518] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:49 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:49.916711 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:49.917343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:49.924104 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.924578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:49.925347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:49.925782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.051757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:50.060052 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2c52bd16-b71a-4ea4-b761-23074b150cd2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.147577 Jan 28 08:08:50.060622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 264/519] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:49 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:50.061501 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:50.062124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:50.068454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.068908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.069743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.070175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.196525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:50.203632 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-58d52bea-d117-4659-83cd-4643c16308ec tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.145719 Jan 28 08:08:50.204199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 256/520] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:50 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:50.340057 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:50.341114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:50.347550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.348033 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.348802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.349231 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.417823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-73f026b9-4c9c-448a-9433-efb4da862c4a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.081253 Jan 28 08:08:50.418433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 265/521] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:50 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:50.802563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:50.803514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:50.809747 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.810256 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.811042 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.811502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.858257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:50.858960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:50.866500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.866955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.867811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:50.868252 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:50.881637 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9cc6fb7a-99af-4152-a483-231fc1207ece tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.083239 Jan 28 08:08:50.884612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 257/522] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:50 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:51.007467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:51.015016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4655d99a-60ff-4d1a-8e2e-bda79db70dfa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.160814 Jan 28 08:08:51.015624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 266/523] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:50 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:51.077214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:51.077928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:51.085042 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.085601 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.086391 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.086826 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.108107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-03bcdadf-4e7a-4e85-86c0-2eef39d94a17 req-941eb60c-9ccc-44f3-8344-44e5e7eb4490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f412d-6440-4287-85f8-ce4bee9d3a7b", "name": "network-vif-plugged", "status": "completed", "tag": "a9af858f-2b7c-47b5-b571-4c23a99fb8ac"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:51.109661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:51.109661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:08:51.116956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-03bcdadf-4e7a-4e85-86c0-2eef39d94a17 req-941eb60c-9ccc-44f3-8344-44e5e7eb4490 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.119575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-03bcdadf-4e7a-4e85-86c0-2eef39d94a17 req-941eb60c-9ccc-44f3-8344-44e5e7eb4490 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.131828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-03bcdadf-4e7a-4e85-86c0-2eef39d94a17 req-941eb60c-9ccc-44f3-8344-44e5e7eb4490 service nova] Creating event network-vif-plugged:a9af858f-2b7c-47b5-b571-4c23a99fb8ac for instance f64f412d-6440-4287-85f8-ce4bee9d3a7b on hv-cinder-80403 Jan 28 08:08:51.136602 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-03bcdadf-4e7a-4e85-86c0-2eef39d94a17 req-941eb60c-9ccc-44f3-8344-44e5e7eb4490 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Jan 28 08:08:51.137269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 267/524] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:51.221647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:51.222140 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:51.222356 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:51.229131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.229607 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.230446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.230631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0ed481fc-4a8a-4e09-8279-4643cdb180ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.157471 Jan 28 08:08:51.230880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.231203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 258/525] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:51 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:51.362058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:51.369697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0d0beed6-e169-45a4-8840-28d2f972d05b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.152154 Jan 28 08:08:51.370271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 268/526] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:51 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:51.429325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:51.430248 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:51.436551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.437002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.437780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.438222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.532434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-59217e0d-24c4-43d6-b857-f8f341a8f06b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.106616 Jan 28 08:08:51.533095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 259/527] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:51 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:51.892555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:51.893442 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:51.900346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.900801 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:51.901582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:51.902018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.031864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:52.032561 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:52.039586 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.040040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.040845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.041535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.052629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-40cc75d2-6e3c-4fbd-80a6-58d2c13e59f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.163678 Jan 28 08:08:52.054131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 269/528] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:51 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:52.165888 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:52.173887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fe53ea1a-e996-44df-ae0d-2f021641fe8d tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.145957 Jan 28 08:08:52.174454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 260/529] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:52 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:52.248286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:52.248972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:52.306193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.306636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.307456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.307887 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.386247 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:52.386868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:52.393358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.393813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.394593 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.395034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.438641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:52.447198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f045e4eb-e331-4e16-b13e-6fac1639bf8f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.202930 Jan 28 08:08:52.447795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 270/530] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:52 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:52.519558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:52.526869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-79c50b65-ec03-42b5-8f79-d703e36ab5cc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.144371 Jan 28 08:08:52.527577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 261/531] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:52 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:52.544686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:52.545605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:52.552430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.552884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.553661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:52.554099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:52.766465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9e3041a2-4c74-481a-8a11-c3516fc9b524 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.225487 Jan 28 08:08:52.767297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 271/532] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:52 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:53.064330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:53.065295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:53.071626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.072075 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.072844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.073282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.140239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ea011eb4-4b99-4a61-973c-b4cdd048213e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.079530 Jan 28 08:08:53.140884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 262/533] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:53 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:53.195576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:53.196286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:53.203182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.203667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.204663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.204873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.331353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:53.339838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-516a484a-37fc-4b33-af8a-51d11998f3e8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1317 microversion: 2.1 time: 0.148803 Jan 28 08:08:53.340399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 272/534] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:53 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:53.464418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:53.465120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:53.471933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.472389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.473164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.473647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.543216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:53.543856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:53.550027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.550479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.551291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.551738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.614635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:53.622779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-90bbd52a-6e61-490c-9bc2-c3f332e16155 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.162308 Jan 28 08:08:53.623580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 263/535] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:53 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:53.680998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:53.688205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a83bc620-2c46-4fcc-823d-2417cc5390c8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.148869 Jan 28 08:08:53.688764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 273/536] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:53 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:53.777353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:53.778271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:53.784731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.785224 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.786009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:53.786448 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:53.875568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7cb78f6d-8f4d-4499-a4e6-d0224e1e89a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.101736 Jan 28 08:08:53.876173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 264/537] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:53 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:54.151772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:54.152644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:54.159651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.160098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.161365 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.161796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.230591 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8ae0a59e-6a51-49db-9881-27a17955ff56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.082617 Jan 28 08:08:54.231284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 274/538] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:54 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:54.357010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:54.357774 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:54.364691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.365139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.365908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.366335 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.496434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:54.504135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-eedbed72-dff9-4da4-9a1d-a587f9552ad5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1507 microversion: 2.1 time: 0.151483 Jan 28 08:08:54.504703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 265/539] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:54 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:54.641073 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:54.641770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:54.649448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.649940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.650929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.651435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.705679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:54.706244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:54.713220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.713682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.714468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.714906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.788639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:54.796838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2e26750a-8ae4-4bfb-b75a-6532496dda7f tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.159917 Jan 28 08:08:54.797405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 275/540] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:54 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:54.848573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:54.855869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5dfae8da-045d-4a8d-a3cd-148bf857e29c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.153972 Jan 28 08:08:54.856665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 266/541] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:54 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:54.888286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:54.889277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:54.895100 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.896132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.896922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.897362 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.921316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-ba87dfab-3635-4209-a2c0-52f4bd691b3d req-3dbc37df-650c-44de-a33e-243352bcef15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3c2928-f7b0-4653-af54-0f776c2cd0b1", "name": "network-vif-plugged", "status": "completed", "tag": "0e912ecb-28e4-404c-b81f-04816b4beb29"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:54.922991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:08:54.922991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:08:54.930378 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-ba87dfab-3635-4209-a2c0-52f4bd691b3d req-3dbc37df-650c-44de-a33e-243352bcef15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:54.930789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-ba87dfab-3635-4209-a2c0-52f4bd691b3d req-3dbc37df-650c-44de-a33e-243352bcef15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:54.941293 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-ba87dfab-3635-4209-a2c0-52f4bd691b3d req-3dbc37df-650c-44de-a33e-243352bcef15 service nova] Creating event network-vif-plugged:0e912ecb-28e4-404c-b81f-04816b4beb29 for instance 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 on hv-cinder-80403 Jan 28 08:08:54.946522 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-ba87dfab-3635-4209-a2c0-52f4bd691b3d req-3dbc37df-650c-44de-a33e-243352bcef15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Jan 28 08:08:54.947140 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 267/542] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:54.977520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cb6bc544-4fc2-43ed-996b-7c419479dfd4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.093065 Jan 28 08:08:54.978696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 276/543] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:54 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:55.243485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:55.244581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:55.251675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.252127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.252910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.253411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.323632 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f676f897-e032-4437-b4dc-95ab2902d4dd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.084953 Jan 28 08:08:55.324692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 268/544] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:55 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:55.814142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:55.814836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:55.821635 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.822091 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.822890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.823353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.872848 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:55.873650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:55.880690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.881144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.881924 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.882360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.949954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:55.957981 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6880f1aa-430a-44ed-b9e3-8d020fdd9b95 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.147834 Jan 28 08:08:55.959379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 277/545] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:55 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:55.988952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:55.989870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:55.995615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.996072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:55.996873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:55.997312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:56.008003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:56.015310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aea25bd1-5585-4fa8-a39f-679355ba3a81 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.146394 Jan 28 08:08:56.015881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 269/546] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:55 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:56.061311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9879cac7-5e49-4c2d-93be-f7f6814c6926 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.075813 Jan 28 08:08:56.061924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 278/547] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:55 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:56.335274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:56.336210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:56.342388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:56.343873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:56.343873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:56.344139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:56.449139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3c3f7a3c-42b5-4048-9d44-f5cb2c5507d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.117442 Jan 28 08:08:56.449704 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 270/548] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:56 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:56.976119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:56.976841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:56.983736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:56.984190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:56.984970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:56.985405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.032611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:57.033422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:57.041533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.041987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.042767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.043206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.123265 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:57.131347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b347358e-876c-43eb-af08-b2a0026f8a22 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.159726 Jan 28 08:08:57.135318 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 279/549] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:56 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:57.136464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:57.137364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:57.143332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.143788 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.144564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.144998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.182173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:57.189515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d3d5981a-a46a-4dd8-9272-4002c5f5c397 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1318 microversion: 2.1 time: 0.160900 Jan 28 08:08:57.190077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 271/550] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:57 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:57.210800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3358dff4-7589-43bf-b133-6aa0b03252e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.077490 Jan 28 08:08:57.211479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 280/551] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:57 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:57.267532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a2e56a-00ed-4b0c-873c-f80fd1bec93f"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:57.268502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:57.274444 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.279559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.279559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.279559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.461556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:57.462561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:57.469460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.469908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.470681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:57.471117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:57.545752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2f8738ee-347b-423e-a835-caf94fdd549d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 28675 microversion: 2.20 time: 0.088678 Jan 28 08:08:57.546426 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 281/552] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:57 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 28675 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:08:58.044004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2ae9fd20-ad2f-4748-bc4e-86e0b2a304e0 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "POST /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780229 Jan 28 08:08:58.044784 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 272/553] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:08:57 2022] POST /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:08:58.149166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:58.149900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:58.156728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.157184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.157971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.158461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.206359 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:58.207210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:58.213980 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.214425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.215199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.217220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.297892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:58.306514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6d7807d4-e54e-4a31-aa60-09b59a969b50 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.161390 Jan 28 08:08:58.307085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 282/554] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:58 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:58.318944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:58.319988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:58.326993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.327479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.328266 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.328704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.354580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:58.361909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ce9b4a1a-ceb4-4890-b7ce-7612656c9fe5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1505 microversion: 2.1 time: 0.159850 Jan 28 08:08:58.362477 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 273/555] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:58 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:08:58.395127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a5b96eaf-208d-4bf0-a39c-fa12b34c3e1f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28643 microversion: 2.1 time: 0.081774 Jan 28 08:08:58.396186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 283/556] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:58 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28643 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:08:58.557737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:58.558706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:58.565481 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.566005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.566793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:58.567229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:58.650806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7243c7ce-6138-470d-87d1-b024fad56611 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 29423 microversion: 2.20 time: 0.096524 Jan 28 08:08:58.651406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 274/557] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:58 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 29423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:08:59.324490 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:08:59.325187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:59.332189 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.332640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.333411 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.334404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.406703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:59.407776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:59.415002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.415483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.416622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.417062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.460297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:08:59.468387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-009d5e3a-e235-4c70-ac0d-df97487ec080 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.147957 Jan 28 08:08:59.468959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 284/558] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:08:59 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:08:59.511701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5d460967-ab8f-4c80-91df-d8dedba32100 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 28675 microversion: 2.1 time: 0.108939 Jan 28 08:08:59.512352 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 275/559] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:08:59 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 28675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:08:59.661787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:08:59.662726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:08:59.669796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.670379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.671064 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:08:59.671529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:08:59.764903 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dbd13140-ddc5-4f29-bfac-4f4d7c445af9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 30897 microversion: 2.20 time: 0.106721 Jan 28 08:08:59.765536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 285/560] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:08:59 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 30897 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:00.485731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:00.486340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:00.493438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.493887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.494951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.495413 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.524716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:00.525705 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:00.532673 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.533127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.533926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.534355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.649529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ff0950df-172b-4128-a92f-11164ff8df5a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 30077 microversion: 2.1 time: 0.129709 Jan 28 08:09:00.650186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 286/561] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:00 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 30077 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:00.777866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:00.778796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:00.786249 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.786707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.787519 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:00.787958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:00.865896 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:00.873575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f25c3b55-5726-45eb-9295-90699561a6c0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.391913 Jan 28 08:09:00.874136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 276/562] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:00 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:00.886393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-af1a5f81-665c-45da-89d4-c936f6a3eee7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 31925 microversion: 2.20 time: 0.112532 Jan 28 08:09:00.887044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 287/563] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:00 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 31925 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:01.661499 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:01.662959 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:01.669486 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:01.669932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:01.670703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:01.671141 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:01.891151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:01.891898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:01.899325 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:01.899800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:01.900581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:01.901023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:02.030993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:02.039793 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-67986041-a0ec-4d2d-9a90-d49140a60509 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.152690 Jan 28 08:09:02.040365 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 288/564] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:01 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:02.045287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:02.046245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:02.051778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:02.052237 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:02.053106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:02.053546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:02.117353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d05af0da-04de-4905-ac1a-d4b52370bdcd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 31568 microversion: 2.1 time: 0.459273 Jan 28 08:09:02.118002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 277/565] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:01 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 31568 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:02.215324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3ceb494c-5420-48e2-ad53-b7cdadb70ebb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 33004 microversion: 2.20 time: 0.173144 Jan 28 08:09:02.219031 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 289/566] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:02 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 33004 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:03.058820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:03.059562 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:03.066388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.066840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.067736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.068178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.129796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:03.130808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:03.137523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.137968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.138807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.139238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.203903 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:03.212113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f44ce48d-a4bf-4587-b0ac-801b001d73e8 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1566 microversion: 2.1 time: 0.157302 Jan 28 08:09:03.212714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 278/567] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:03 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:03.226336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:03.227269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:03.233533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.234030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.235517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:03.235976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:03.239045 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b0011dc2-a8a7-454e-9070-c3a11c64fb32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 32547 microversion: 2.1 time: 0.113269 Jan 28 08:09:03.240337 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 290/568] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:03 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 32547 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:03.390790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-44097644-7ff0-496a-ad86-13714a1f6099 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 33531 microversion: 2.20 time: 0.168377 Jan 28 08:09:03.391520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 279/569] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:03 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 33531 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:04.230686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:04.231398 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.238271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.238746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.239560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.240021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.252489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:04.253491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.260410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.260897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.261681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.262122 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.371048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:04.374309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5e0d5282-7247-4ec3-ad05-26827a023f0a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 32971 microversion: 2.1 time: 0.125700 Jan 28 08:09:04.375065 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 280/570] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:04 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 32971 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:04.380344 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-80dfdea5-b497-45a0-a501-1495c406923b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1546 microversion: 2.1 time: 0.153653 Jan 28 08:09:04.380912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 291/571] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:04 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:04.397252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:04.402860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:04.403815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.406973 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.410272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.410652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.411508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.411975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.415526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.416241 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.417020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.417469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.538757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b3751383-56bd-4950-8ad9-09c5bbc34c4e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 33846 microversion: 2.20 time: 0.139494 Jan 28 08:09:04.542100 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 292/572] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:04 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 33846 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:04.549439 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] HTTP exception thrown: Cannot 'detach_volume' instance d4e823ff-de17-4756-8990-8c2cdc9bd349 while it is in vm_state rescued Jan 28 08:09:04.550031 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Returning 409 to user: Cannot 'detach_volume' instance d4e823ff-de17-4756-8990-8c2cdc9bd349 while it is in vm_state rescued {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:04.550841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-45e496c7-310d-4c77-97d6-13bc140b6eae tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments/7593db37-6dc5-424f-b9a1-353fea5c1b6b" status: 409 len: 152 microversion: 2.1 time: 0.158446 Jan 28 08:09:04.551415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 281/573] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:09:04 2022] DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments/7593db37-6dc5-424f-b9a1-353fea5c1b6b => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 08:09:04.559835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:04.560458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.567414 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.568376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.569160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.569598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.805497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f88f2d0f-06f0-4238-9c73-c9a1589e9ee4 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action" status: 202 len: 0 microversion: 2.1 time: 0.249331 Jan 28 08:09:04.806140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 293/574] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:04 2022] POST /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:04.814207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:04.814845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:04.822564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.823051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.823936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:04.824410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:04.955824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:04.964783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fbca5fb5-72ba-4715-ab2a-1eaaf8e6acfe tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1554 microversion: 2.1 time: 0.154295 Jan 28 08:09:04.966578 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 282/575] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:04 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:05.387544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:05.391976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:05.399563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.400011 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:05.400792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.401225 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:05.487599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-368a7996-66d7-45ac-a19d-0754b8719f82 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 33351 microversion: 2.1 time: 0.104237 Jan 28 08:09:05.488522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 294/576] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:05 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 33351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:05.550484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:05.551511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:05.558295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.558811 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:05.559618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.560047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:05.678810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-782cd8eb-fa67-4dd1-b483-87b65fa8025e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 34475 microversion: 2.20 time: 0.131831 Jan 28 08:09:05.679485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 283/577] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:05 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 34475 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:05.982837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:05.983569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:05.991058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.991408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:05.992190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:05.992632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.128172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:06.135733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-65ced4f1-76ee-492b-b075-aeff0f6b0150 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1554 microversion: 2.1 time: 0.157030 Jan 28 08:09:06.136288 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 295/578] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:05 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:06.499971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:06.500970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:06.507952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.508363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.509287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.509732 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.594567 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-037763d7-2889-476e-b167-39799461ed80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 33962 microversion: 2.1 time: 0.098535 Jan 28 08:09:06.595199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 284/579] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:06 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 33962 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:06.648181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:06.648675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:06.655119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.655608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.656474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.656913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.691121 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:06.692203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:06.699541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.700142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.700945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.701370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.735731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lazy-loading 'services' on Instance uuid f64f412d-6440-4287-85f8-ce4bee9d3a7b {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:06.794665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-98152a08-18a4-42b0-8d7e-948c7345c87b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 34978 microversion: 2.20 time: 0.107499 Jan 28 08:09:06.795356 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 285/580] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:06 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 34978 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:06.955002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-508c594e-f627-4c96-863d-ef5e21f8f3d9 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments/19a2e56a-00ed-4b0c-873c-f80fd1bec93f" status: 202 len: 0 microversion: 2.1 time: 0.310742 Jan 28 08:09:06.955652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 296/581] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:09:06 2022] DELETE /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments/19a2e56a-00ed-4b0c-873c-f80fd1bec93f => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:06.964843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:06.965856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:06.972611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.973054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:06.973818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:06.974245 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.007284 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8f6b8830-ae6e-4e4a-92a9-85bd962ea721 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Jan 28 08:09:07.007839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 286/582] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:06 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:07.152982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:07.153684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:07.159812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.160265 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.161037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.161472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.289889 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:07.298042 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2b211812-7f38-4785-bcd4-e4fbd740956d tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1554 microversion: 2.1 time: 0.149121 Jan 28 08:09:07.298596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 297/583] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:07 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:07.605880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:07.606792 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:07.613041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.613490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.614260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.614698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.720135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3cc75bcf-c547-4230-b1a0-cb372dede5f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 34520 microversion: 2.1 time: 0.117630 Jan 28 08:09:07.720700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 287/584] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:07 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 34520 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:07.809185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:07.810159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:07.816618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.817055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.818460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:07.818904 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:07.914658 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-92011d1b-b404-4fdd-8fff-1d110e1646df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 35556 microversion: 2.20 time: 0.108996 Jan 28 08:09:07.915334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 298/585] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:07 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 35556 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:08.019979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:08.020954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:08.028078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.028529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.029326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.029765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.061294 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-94e849e0-6b9f-4641-86ab-f8ff682e5e50 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Jan 28 08:09:08.061909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 288/586] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:08 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:08.315468 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:08.316159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:08.323433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.323893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.324679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.325106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.460042 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:08.467965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-313bd27a-c0e3-4ec0-9a9c-f2db43c315ca tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1554 microversion: 2.1 time: 0.156527 Jan 28 08:09:08.468521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 299/587] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:08 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:08.732276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:08.733210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:08.739739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.740188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.740962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.741393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.843393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fb7d3bd6-dec2-4380-ae85-ae54af374c13 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 35840 microversion: 2.1 time: 0.114815 Jan 28 08:09:08.844041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 289/588] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:08 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 35840 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:08.927254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:08.928188 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:08.934443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.934924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:08.935728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:08.936159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.041857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0c510cb4-d794-499c-99c3-a9826b40cddd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 36256 microversion: 2.20 time: 0.117994 Jan 28 08:09:09.042429 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 300/589] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:08 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 36256 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:09.073742 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:09.074753 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:09.081606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.082059 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.082839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.083351 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.112046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fc62f7cf-7a10-4beb-ab61-996b5a9558c8 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042422 Jan 28 08:09:09.112600 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 290/590] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:09 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:09:09.485847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:09.486677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:09.493894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.494412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.495182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.495634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.629647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:09.637842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-800674cc-9e91-49e7-bc4f-803bc792fe73 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1554 microversion: 2.1 time: 0.156237 Jan 28 08:09:09.638412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 301/591] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:09 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:09.855144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:09.856024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:09.862231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.862722 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.863525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:09.863962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:09.958182 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f05b4f19-3f42-4a41-ac8b-4fc15c4ddbcb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 36493 microversion: 2.1 time: 0.106666 Jan 28 08:09:09.959461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 291/592] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:09 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 36493 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:10.054304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:10.055204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:10.061429 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.062827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.062827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.063144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.170846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f43c0db8-4d11-4ce0-9726-f7300855f057 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 36967 microversion: 2.20 time: 0.120508 Jan 28 08:09:10.171441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 302/593] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:10 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 36967 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:10.484137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:10.484727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:10.492101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.492573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.493345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.493779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.518949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:10.655271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:10.656026 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:10.663602 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.664059 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.664852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.665291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.797251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:10.806367 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5890e5be-0465-4470-af4b-cb0e580847b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1560 microversion: 2.1 time: 0.155098 Jan 28 08:09:10.806934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 303/594] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:10 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:10.872202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:10.872702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:10.879478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.880295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.880798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.881241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.887422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d1aac4d5-efa7-4179-b02e-a6249bcadd1b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 204 len: 0 microversion: 2.1 time: 0.406910 Jan 28 08:09:10.888114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 292/595] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:10 2022] DELETE /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:09:10.897039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:10.897840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:10.903831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.904392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.905460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:10.905956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:10.961157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'services' on Instance uuid d4e823ff-de17-4756-8990-8c2cdc9bd349 {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:11.043943 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:11.051108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0de4330a-2839-4709-b245-c75ec6d21fd3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1513 microversion: 2.1 time: 0.158619 Jan 28 08:09:11.051697 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 293/596] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:10 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:11.055898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:11.056832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:11.062469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.062938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.063724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.064151 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.164664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-af66d059-e2e0-44a4-b269-c1172a66fe04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 37558 microversion: 2.1 time: 0.111719 Jan 28 08:09:11.165548 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 294/597] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:11 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 37558 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:11.182834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:11.183990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:11.186707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-87fa9d54-b65c-4928-88d8-7402e4ab7fbc tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments/7593db37-6dc5-424f-b9a1-353fea5c1b6b" status: 202 len: 0 microversion: 2.1 time: 0.318053 Jan 28 08:09:11.187652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 304/598] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:09:10 2022] DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments/7593db37-6dc5-424f-b9a1-353fea5c1b6b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:11.191012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.191489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.192277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.193216 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.197373 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:11.198546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:11.204815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.209474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.209474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:11.209474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:11.319362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-25c863a6-7ab7-4f91-b3a8-777ea5e8395b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 37843 microversion: 2.20 time: 0.140704 Jan 28 08:09:11.320215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 295/599] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:11 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 37843 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:11.341834 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b1276732-225c-4b03-bb3e-d464d63bb2cd tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149786 Jan 28 08:09:11.342870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 305/600] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:11 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:09:12.068196 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:12.068908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:12.075752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.076214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.076992 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.077432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.178608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:12.186540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:12.186540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.187277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.187880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.188081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.210612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:12.218401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ea0c23c5-eb8d-4c7e-bdf7-63874d527f93 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1513 microversion: 2.1 time: 0.154205 Jan 28 08:09:12.218977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 296/601] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:12 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:12.281462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7f5f3222-9120-4090-aebf-da008307521a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 38062 microversion: 2.1 time: 0.108172 Jan 28 08:09:12.282148 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 306/602] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:12 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 38062 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:12.332266 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:12.333376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:12.339853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.340490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.342651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.342651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.353867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:12.355378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:12.362596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.363129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.364006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:12.364974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:12.395586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-671253e9-25fa-46e4-9685-bd23485c66bb tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Jan 28 08:09:12.398786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 307/603] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:12 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:09:12.433895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2b06068a-9112-4607-8d02-140c660c40ef tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 38199 microversion: 2.20 time: 0.105259 Jan 28 08:09:12.438833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 297/604] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:12 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 38199 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:13.234796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:13.235489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:13.241854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.242311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.243088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.243553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.295089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:13.296231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:13.303176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.303668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.304452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.304893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.375935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:13.383927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a6deaa2d-69d7-4853-b907-8f375fc6831c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1513 microversion: 2.1 time: 0.152840 Jan 28 08:09:13.384501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 308/605] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:13 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:13.385944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-94937180-0bee-4b5b-bfc9-6bf7ea0adc24 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 38136 microversion: 2.1 time: 0.094830 Jan 28 08:09:13.386679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 298/606] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:13 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 38136 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:13.406841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:13.407798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:13.414410 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.414888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.415940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.416378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.446259 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-35da2dc2-85d1-4f0f-a39d-c3d686a0b512 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043143 Jan 28 08:09:13.446810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 309/607] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:09:13 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:09:13.449672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:13.450679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:13.457773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.458273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.459591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:13.460030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:13.773108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-76771d9b-0a1a-4dab-aee0-bba832693654 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 38208 microversion: 2.20 time: 0.321145 Jan 28 08:09:13.773108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 299/608] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:13 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 38208 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:14.313833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-080c81a6-ba41-4241-bfcd-ecd015234da5 req-934745a6-336c-4f32-ba0c-79b165e33a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f412d-6440-4287-85f8-ce4bee9d3a7b", "name": "network-vif-deleted", "tag": "a9af858f-2b7c-47b5-b571-4c23a99fb8ac"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:14.315545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:14.315545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:09:14.322722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-080c81a6-ba41-4241-bfcd-ecd015234da5 req-934745a6-336c-4f32-ba0c-79b165e33a9c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.323238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-080c81a6-ba41-4241-bfcd-ecd015234da5 req-934745a6-336c-4f32-ba0c-79b165e33a9c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.334743 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-080c81a6-ba41-4241-bfcd-ecd015234da5 req-934745a6-336c-4f32-ba0c-79b165e33a9c service nova] Creating event network-vif-deleted:a9af858f-2b7c-47b5-b571-4c23a99fb8ac for instance f64f412d-6440-4287-85f8-ce4bee9d3a7b on hv-cinder-80403 Jan 28 08:09:14.339551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-080c81a6-ba41-4241-bfcd-ecd015234da5 req-934745a6-336c-4f32-ba0c-79b165e33a9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 Jan 28 08:09:14.340145 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 310/609] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:14.398933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:14.400630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:14.401160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:14.401864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:14.407712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.408119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.408231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.408569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.409401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.409571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.410051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.410189 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.475144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:14.482570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8cc7df07-5854-46f7-91fb-246a6d509606 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 200 len: 1471 microversion: 2.1 time: 0.085858 Jan 28 08:09:14.483685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 311/610] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:14 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:14.487774 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-51b9f291-d563-4c1e-afb1-46716a11d62d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 38136 microversion: 2.1 time: 0.093149 Jan 28 08:09:14.489133 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 300/611] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:14 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 38136 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:14.781889 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:14.782977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:14.792268 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.792730 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.793520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:14.794137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:14.982213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bc748ff3-083c-4c7a-b4d6-3ed02f2d56bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 200 len: 38342 microversion: 2.20 time: 0.204378 Jan 28 08:09:14.982975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 312/612] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:14 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 38342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:14.993582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:14.994161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:15.000987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.002887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.002887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.002887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.031712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f7b77e5e-3864-485c-955e-fa06d155ebe4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/ips" status: 200 len: 151 microversion: 2.20 time: 0.037232 Jan 28 08:09:15.031712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 301/613] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jan 28 08:09:14 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:09:15.500127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:15.500706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:15.501162 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:15.501266 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: f64f412d-6440-4287-85f8-ce4bee9d3a7b] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:15.508467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.508947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.509339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.509737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.509869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.510174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.510661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:15.511103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:15.527087 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Instance f64f412d-6440-4287-85f8-ce4bee9d3a7b could not be found. Jan 28 08:09:15.530913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 404 to user: Instance f64f412d-6440-4287-85f8-ce4bee9d3a7b could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:15.530913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cbc924c5-b0fa-4be2-8edd-79d4831abac7 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b" status: 404 len: 111 microversion: 2.1 time: 0.032386 Jan 28 08:09:15.530913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 313/614] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:15 2022] GET /compute/v2.1/servers/f64f412d-6440-4287-85f8-ce4bee9d3a7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:09:15.658569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd0183e5-c8d6-4641-af31-a51658fcd448 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 38136 microversion: 2.1 time: 0.161883 Jan 28 08:09:15.659131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 302/615] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:15 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 38136 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:16.115018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:16.119836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:16.123489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.124162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.125385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.126094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.165949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:16.550173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7d165ef7-a7e9-4385-9a2f-ff9a9cb03b1c tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "DELETE /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 204 len: 0 microversion: 2.1 time: 0.438737 Jan 28 08:09:16.550838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 314/616] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:16 2022] DELETE /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:09:16.559891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:16.570257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:16.570257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.570257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.570257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.570622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.671098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:16.672126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:16.678939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.679324 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.682683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.682683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.730782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:16.738180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-06d19255-1c01-4cd8-ace4-fe2b1331a0d2 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1506 microversion: 2.1 time: 0.182718 Jan 28 08:09:16.738757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 303/617] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:16 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:16.768298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0def39a3-e3b1-4d39-8254-572551956fcc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 200 len: 38267 microversion: 2.1 time: 0.101044 Jan 28 08:09:16.769197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 315/618] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:16 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 38267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:09:16.779670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:16.780359 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:16.786240 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.786723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.787528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.787969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.821336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-10540fb7-c4a3-4d04-9576-5738205aca7c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/ips" status: 200 len: 144 microversion: 2.1 time: 0.045297 Jan 28 08:09:16.822290 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 304/619] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:09:16 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:16.823049 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:16.823696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:16.830794 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.831879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.832665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:16.833133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:16.862736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:17.167705 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-15b1316c-8f89-4c00-97ca-ce9835b0bc4e tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 204 len: 0 microversion: 2.1 time: 0.348361 Jan 28 08:09:17.168290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 316/620] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:16 2022] DELETE /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 08:09:17.179533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:17.180187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:17.186586 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:17.187041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:17.187961 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:17.188404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:17.327988 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:17.335376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9492d1d2-7145-4387-8918-9e725a81592c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1514 microversion: 2.1 time: 0.160096 Jan 28 08:09:17.335949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 305/621] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:17 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:17.755831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:17.756562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:17.763842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:17.764290 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:17.765071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:17.765503 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:17.889761 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:17.897587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6c2102e7-af45-4d15-a3cd-26d1565fd844 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1506 microversion: 2.1 time: 0.145861 Jan 28 08:09:17.898160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 317/622] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:17 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:18.351866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:18.352480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:18.358660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:18.359107 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:18.359916 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:18.360348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:18.493097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:18.500636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-af9521a0-b5ec-4c51-94b8-6d8c0d8a872b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1514 microversion: 2.1 time: 0.152432 Jan 28 08:09:18.501218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 306/623] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:18 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:18.915784 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:18.916460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:18.925117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:18.925575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:18.926366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:18.926859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.061004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:19.069450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f7a3f490-d624-4d5e-9a0e-4ce7dcb72738 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1506 microversion: 2.1 time: 0.159303 Jan 28 08:09:19.070216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 318/624] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:18 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:19.225776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:19.226297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:19.232547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.232911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.233712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.234128 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.256168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lazy-loading 'flavor' on Instance uuid eff2ba16-416f-418a-8b21-56d5ae8a2e32 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:19.516973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:19.517512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:19.524057 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.524504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.525314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.525743 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.664911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:19.672672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c177bba6-432d-47ac-9f92-364fa7b7ff82 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1514 microversion: 2.1 time: 0.159353 Jan 28 08:09:19.673227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 319/625] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:19 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:19.888060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-df3ecff5-511c-46fc-8743-2fcb56fe9f3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 202 len: 0 microversion: 2.20 time: 0.666022 Jan 28 08:09:19.892183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 307/626] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:09:19 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:09:19.899179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:19.900694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:19.905836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.906554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:19.907374 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:19.907825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:20.054329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:20.062168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:20.063730 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:20.064883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-53f81963-df8f-4c01-942d-b891b16e9851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.171387 Jan 28 08:09:20.065686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 320/627] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:19 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:20.086092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:20.086837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:20.092998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:20.093430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:20.094204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:20.094640 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:20.220381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:20.230096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c8c4270d-8e32-47ca-b83e-02606c3d8cef tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1506 microversion: 2.1 time: 0.147827 Jan 28 08:09:20.230981 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 308/628] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:20 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:20.689234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:20.689844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:20.696269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:20.696659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:20.697445 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:20.697883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:20.825727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:20.833174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-765a45d0-a261-484c-854f-3166cc201dff tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1514 microversion: 2.1 time: 0.147583 Jan 28 08:09:20.833824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 321/629] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:20 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:21.083318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:21.084669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:21.092666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.093127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.093970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.094552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.171598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-17616c7c-2cd9-45f6-bb3f-656f59f7fba4 req-6a1f905a-95ec-4112-829b-f0f1251b14ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85aa54d-ba74-47b8-9b76-f6e864410c3f", "name": "network-vif-deleted", "tag": "c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:21.173382 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:21.173382 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:09:21.187436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-17616c7c-2cd9-45f6-bb3f-656f59f7fba4 req-6a1f905a-95ec-4112-829b-f0f1251b14ed service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.187436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-17616c7c-2cd9-45f6-bb3f-656f59f7fba4 req-6a1f905a-95ec-4112-829b-f0f1251b14ed service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.200656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-17616c7c-2cd9-45f6-bb3f-656f59f7fba4 req-6a1f905a-95ec-4112-829b-f0f1251b14ed service nova] Creating event network-vif-deleted:c28fb67d-a3dd-45be-8ad9-6d6f1220b0d1 for instance c85aa54d-ba74-47b8-9b76-f6e864410c3f on hv-cinder-80403 Jan 28 08:09:21.208355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-17616c7c-2cd9-45f6-bb3f-656f59f7fba4 req-6a1f905a-95ec-4112-829b-f0f1251b14ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039872 Jan 28 08:09:21.209270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 322/630] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:21.250690 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb0f1aff-5090-40f5-b4b4-01e82cee589c"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:21.252066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:21.258862 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.259346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.260172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.260612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.297938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:21.314719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:21.316277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:21.322398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a051226d-9ea6-42b8-b1bf-54e133a6e7d8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.238422 Jan 28 08:09:21.325527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 309/631] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:21 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:21.344150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:21.348085 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:21.352081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.352544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.353501 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.354108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.569234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:21.576751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3c9b4380-6014-4085-9105-b3c3ea648231 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1506 microversion: 2.1 time: 0.238657 Jan 28 08:09:21.577329 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 310/632] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:21 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:21.849801 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:21.850468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:21.856521 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.857218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.858163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.858750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.891515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:21.891970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:21.892425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lazy-loading 'fault' on Instance uuid c85aa54d-ba74-47b8-9b76-f6e864410c3f {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:21.934118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:21.941358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-17a2514e-5fbc-41fc-b073-9d37abe285aa tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 200 len: 1307 microversion: 2.1 time: 0.095231 Jan 28 08:09:21.941922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 311/633] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:21 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:22.151973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1274d0f6-f632-4905-b4a6-8f946b235482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907171 Jan 28 08:09:22.152560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 323/634] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:09:21 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:22.342860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:22.343495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:22.349919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.350376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.351150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.351714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.494685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:22.502735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:22.504281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:22.505466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd98d398-924b-4c89-928b-36d215585699 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.166274 Jan 28 08:09:22.506027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 312/635] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:22 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:22.594028 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:22.594725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:22.601359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.601818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.602594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.603033 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.634233 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.634683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.635133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'fault' on Instance uuid 449f4c98-79fa-43de-9457-1e3b5bc6e93c {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:22.673814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:22.680734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f2c4ce49-594b-4f67-afd5-6c6ae6256ae6 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 200 len: 1311 microversion: 2.1 time: 0.091172 Jan 28 08:09:22.681304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 324/636] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:22 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:22.957619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:22.958162 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: c85aa54d-ba74-47b8-9b76-f6e864410c3f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:22.963972 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.964431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.965200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.965637 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.978457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Instance c85aa54d-ba74-47b8-9b76-f6e864410c3f could not be found. Jan 28 08:09:22.979038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 404 to user: Instance c85aa54d-ba74-47b8-9b76-f6e864410c3f could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:22.979902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ea5424cc-f396-4887-b143-784a102401e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f" status: 404 len: 111 microversion: 2.1 time: 0.025960 Jan 28 08:09:22.980422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 313/637] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:22 2022] GET /compute/v2.1/servers/c85aa54d-ba74-47b8-9b76-f6e864410c3f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:09:22.988323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:22.988820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:22.995151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.995641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:22.996410 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:22.996841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.021156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:23.226347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-1333664a-d40d-4230-9a85-0c18c04918d9 req-24d66b58-a5d0-49a0-bf79-4beaac217e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f4c98-79fa-43de-9457-1e3b5bc6e93c", "name": "network-vif-deleted", "tag": "795f771c-454b-4288-b77b-9f274f0cb6d5"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:23.228303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:23.228303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:09:23.235452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-1333664a-d40d-4230-9a85-0c18c04918d9 req-24d66b58-a5d0-49a0-bf79-4beaac217e09 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.236078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-1333664a-d40d-4230-9a85-0c18c04918d9 req-24d66b58-a5d0-49a0-bf79-4beaac217e09 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.249220 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-1333664a-d40d-4230-9a85-0c18c04918d9 req-24d66b58-a5d0-49a0-bf79-4beaac217e09 service nova] Creating event network-vif-deleted:795f771c-454b-4288-b77b-9f274f0cb6d5 for instance 449f4c98-79fa-43de-9457-1e3b5bc6e93c on hv-cinder-80403 Jan 28 08:09:23.254483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-1333664a-d40d-4230-9a85-0c18c04918d9 req-24d66b58-a5d0-49a0-bf79-4beaac217e09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Jan 28 08:09:23.255073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 314/638] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:09:23.441687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-47e6df3b-b52f-475c-a74a-b1c7be52c5c3 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 204 len: 0 microversion: 2.1 time: 0.456799 Jan 28 08:09:23.442271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 325/639] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:22 2022] DELETE /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:09:23.450596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:23.451335 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:23.457817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.458273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.459113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.459583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.523739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:23.524343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:23.530314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.530788 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.531596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.532020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.588415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:23.595931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6c9901a5-66d4-46ab-b235-4a281e8f805c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1515 microversion: 2.1 time: 0.149387 Jan 28 08:09:23.596508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 315/640] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:23 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:23.670066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:23.677755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:23.679342 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:23.680486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-84166749-514e-490d-a461-87cda4c96b30 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.161032 Jan 28 08:09:23.681053 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 326/641] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:23 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:09:23.697268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:23.697881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: 449f4c98-79fa-43de-9457-1e3b5bc6e93c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:23.703687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.704137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.704905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.705353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.718376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] HTTP exception thrown: Instance 449f4c98-79fa-43de-9457-1e3b5bc6e93c could not be found. Jan 28 08:09:23.718947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Returning 404 to user: Instance 449f4c98-79fa-43de-9457-1e3b5bc6e93c could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:23.719774 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e021742c-3381-408c-a079-528d57ecd6f9 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c" status: 404 len: 111 microversion: 2.1 time: 0.026109 Jan 28 08:09:23.720284 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 316/642] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:23 2022] GET /compute/v2.1/servers/449f4c98-79fa-43de-9457-1e3b5bc6e93c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:09:23.728376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:23.728885 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:23.734630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.735086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.735928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:23.736367 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:23.759967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:24.136989 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b858453f-45ea-4374-be2e-9680a4c05010 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 204 len: 0 microversion: 2.1 time: 0.411904 Jan 28 08:09:24.137581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 327/643] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:23 2022] DELETE /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:09:24.145350 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:24.146555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:24.152354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.152802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.153567 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.154003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.280318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:24.288119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e5bcf3ff-249b-44ba-9843-24c33d7b69ed tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.146481 Jan 28 08:09:24.288963 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 317/644] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:24 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:24.613477 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:24.614212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:24.620409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.620854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.621620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.622047 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.698867 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:24.699624 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:24.705925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.706450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.707318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:24.707837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:24.747634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:24.755690 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-10ed441e-4f57-436e-930c-09043a25c5e5 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1515 microversion: 2.1 time: 0.145637 Jan 28 08:09:24.756653 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 328/645] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:24 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:24.838508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:24.846130 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:24.847666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:24.848852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ffe90aa8-7dc4-4fe1-b625-ce5b94cc13d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.153812 Jan 28 08:09:24.849406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 318/646] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:24 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:09:25.421281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:25.421281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:25.421281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.421281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.423125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.423125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.452165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:25.460058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fc313850-8f40-47d7-86db-1679214c56f1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.155649 Jan 28 08:09:25.460628 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 329/647] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:25 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:25.772537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:25.773176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:25.780165 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.780621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.781400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.781839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.866957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:25.867596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:25.873755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.874209 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.874980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:25.875448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:25.938973 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:25.946986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-880b96cf-5e56-4c96-9284-534db8dd1dac tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1515 microversion: 2.1 time: 0.178054 Jan 28 08:09:25.947632 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 319/648] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:25 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:26.011848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:26.019532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:26.021308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:26.022450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-954c25a0-47b4-4402-b975-b255a28e4273 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.159626 Jan 28 08:09:26.023003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 330/649] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:25 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:09:26.416404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-8071c358-1fa9-4e21-a36b-9d1a74211a8b req-c6873c6a-8b60-4d82-95b6-31e9d9d9eb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a432d54-4c12-4ab0-a857-792f33ca153c", "name": "network-vif-deleted", "tag": "948eb4ed-3bbe-4557-9569-d90bbd45ccda"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:26.418048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:26.418048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:09:26.425202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-8071c358-1fa9-4e21-a36b-9d1a74211a8b req-c6873c6a-8b60-4d82-95b6-31e9d9d9eb1e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:26.425653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-8071c358-1fa9-4e21-a36b-9d1a74211a8b req-c6873c6a-8b60-4d82-95b6-31e9d9d9eb1e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:26.437446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-8071c358-1fa9-4e21-a36b-9d1a74211a8b req-c6873c6a-8b60-4d82-95b6-31e9d9d9eb1e service nova] Creating event network-vif-deleted:948eb4ed-3bbe-4557-9569-d90bbd45ccda for instance 8a432d54-4c12-4ab0-a857-792f33ca153c on hv-cinder-80403 Jan 28 08:09:26.442664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-8071c358-1fa9-4e21-a36b-9d1a74211a8b req-c6873c6a-8b60-4d82-95b6-31e9d9d9eb1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Jan 28 08:09:26.443325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 320/650] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:26.477205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:26.480224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:26.483750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:26.484238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:26.485016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:26.485453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:26.611409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:26.618654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-639a6476-3820-4170-b259-d961fec0bdf1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.145634 Jan 28 08:09:26.619221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 331/651] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:26 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:26.965249 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:26.965951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:26.972117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:26.972572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:26.973348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:26.973785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.003036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.003532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.003976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lazy-loading 'fault' on Instance uuid 8a432d54-4c12-4ab0-a857-792f33ca153c {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:27.040763 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:27.041376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:27.042856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:27.047632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.050129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.050129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.050129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.050483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-43c31766-a1ee-455a-89f4-ab56564e4eca tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 200 len: 1308 microversion: 2.1 time: 0.089422 Jan 28 08:09:27.050662 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 321/652] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:26 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:27.177500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:27.185197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:27.186818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:27.188008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2d671e81-6ee7-474f-80d4-7b970051b6d2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.151177 Jan 28 08:09:27.188571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 332/653] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:27 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:27.453540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d7f05bf-ba00-47a1-9c6a-db55d8b51f3a", "device": "/dev/sdb"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:27.455124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:27.460776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.461217 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.461984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.462415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.635441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:27.636055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:27.642005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.643394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.643394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:27.643785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:27.772865 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:27.780418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-24be6a1b-6f12-4609-aa47-4dc00a543a0b tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.148685 Jan 28 08:09:27.784263 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 333/654] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:27 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:28.065610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:28.066247 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: 8a432d54-4c12-4ab0-a857-792f33ca153c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:28.073109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.073580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.074325 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.074760 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.087682 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Instance 8a432d54-4c12-4ab0-a857-792f33ca153c could not be found. Jan 28 08:09:28.088259 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 404 to user: Instance 8a432d54-4c12-4ab0-a857-792f33ca153c could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:28.089061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-22f2a5bf-721a-4e51-bb52-e9cd017b3a3b tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c" status: 404 len: 111 microversion: 2.1 time: 0.027150 Jan 28 08:09:28.089584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 334/655] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:28 2022] GET /compute/v2.1/servers/8a432d54-4c12-4ab0-a857-792f33ca153c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:09:28.206945 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:28.207757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:28.213665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.216455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.216455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.216455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.325565 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-603d2371-0b7c-4aae-aed2-18f256a48d8b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "POST /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875328 Jan 28 08:09:28.330707 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 322/656] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:09:27 2022] POST /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:28.349954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:28.357798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:28.359660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:28.360913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-02030d00-dc07-425c-9641-f71ff6d8758c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.157849 Jan 28 08:09:28.361471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 335/657] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:28 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:09:28.798197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:28.798839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:28.805349 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.805804 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.806550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:28.806979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:28.933427 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:28.940699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d749eaf4-e840-46fc-a62a-178c0fc04c39 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.147036 Jan 28 08:09:28.941276 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 323/658] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:28 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:29.380703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:29.381322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:29.387599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.388054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.388835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.389273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.440297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:29.440791 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:29.447117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.447595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.448357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.448785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.473136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:09:29.524845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:29.532774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:29.534326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:29.535514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-197214ab-970b-4e14-88b3-8e754e0016bd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.159162 Jan 28 08:09:29.539289 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 336/659] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:29 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:29.753496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-027d47b5-2810-4b6a-8255-870571719d87 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 204 len: 0 microversion: 2.1 time: 0.316451 Jan 28 08:09:29.754130 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 324/660] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:09:29 2022] DELETE /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 08:09:29.767778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:29.768392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:29.774229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.774677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.775482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.775923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.904545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:29.913748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0bc04ca8-e511-4a37-90e8-91fb59b67b2c tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1513 microversion: 2.1 time: 0.149470 Jan 28 08:09:29.914315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 337/661] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:29 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:29.958100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:29.958918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:29.965141 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.965591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:29.966368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:29.966811 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.094102 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:30.102066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8768f76c-1128-4327-8ac8-d1cd0645efff tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.147935 Jan 28 08:09:30.102584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 325/662] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:29 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:30.554210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:30.554856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:30.561426 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.561880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.562672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.563103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.693395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:30.697610 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-23346c2b-3e28-4a3c-94fd-4f6bdedb3db1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:30.701273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:30.702764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:30.703472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-23346c2b-3e28-4a3c-94fd-4f6bdedb3db1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.703922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-23346c2b-3e28-4a3c-94fd-4f6bdedb3db1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.704027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5c6d198f-39a6-416e-b63a-ec1d8f83777f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.153996 Jan 28 08:09:30.704495 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 338/663] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:30 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:30.761741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-23346c2b-3e28-4a3c-94fd-4f6bdedb3db1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Going to try to stop instance {{(pid=116948) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 08:09:30.934376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:30.935019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:30.940805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.941250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.942024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.942950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.957475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-23346c2b-3e28-4a3c-94fd-4f6bdedb3db1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 202 len: 0 microversion: 2.1 time: 0.263111 Jan 28 08:09:30.958916 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 326/664] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:30 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:09:30.967579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:30.968606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:30.976470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.976928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:30.977720 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:30.978159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.073804 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.081506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b3138eba-4ca9-482f-809b-3a8b4f6196bb tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1513 microversion: 2.1 time: 0.150829 Jan 28 08:09:31.082075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 339/665] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:30 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:31.118890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:31.119526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:31.125207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:31.125654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.126424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:31.126854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.191065 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.200530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8237e279-d3ab-4d2f-9eb5-a373daebf185 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.236866 Jan 28 08:09:31.201155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 327/666] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:30 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:31.261744 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.268990 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ef45d608-bc33-4f77-aecc-d3b0d4a819b0 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1520 microversion: 2.1 time: 0.153721 Jan 28 08:09:31.269554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 340/667] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:31 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:31.457253 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-c6e87a7f-f618-46dc-b008-634ee856b833 req-018d343c-e108-4c8a-b78f-edb308ae54c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e823ff-de17-4756-8990-8c2cdc9bd349", "name": "network-vif-deleted", "tag": "e58b3f10-73a3-40b4-82c2-b1ce7b965488"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:31.458886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:31.458886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:09:31.465514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-c6e87a7f-f618-46dc-b008-634ee856b833 req-018d343c-e108-4c8a-b78f-edb308ae54c3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:31.465974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-c6e87a7f-f618-46dc-b008-634ee856b833 req-018d343c-e108-4c8a-b78f-edb308ae54c3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.476893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-c6e87a7f-f618-46dc-b008-634ee856b833 req-018d343c-e108-4c8a-b78f-edb308ae54c3 service nova] Creating event network-vif-deleted:e58b3f10-73a3-40b4-82c2-b1ce7b965488 for instance d4e823ff-de17-4756-8990-8c2cdc9bd349 on hv-cinder-80403 Jan 28 08:09:31.481854 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-c6e87a7f-f618-46dc-b008-634ee856b833 req-018d343c-e108-4c8a-b78f-edb308ae54c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028394 Jan 28 08:09:31.484198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 328/668] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:31.721580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:31.722118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:31.728932 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:31.729375 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.730137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:31.730608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:31.859594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.867430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.868962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:31.870153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-20e9c512-aa71-4c0f-afcf-23730c53b2c7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.152444 Jan 28 08:09:31.870712 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 341/669] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:31 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:32.098120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:32.099433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:32.105830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.106281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.107052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.107512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.217756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:32.219424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:32.225163 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.225611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.226619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.227218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.266819 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:32.275425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b456638e-8c42-4466-b1a0-c0b2937ae492 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1513 microversion: 2.1 time: 0.181166 Jan 28 08:09:32.276131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 329/670] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:32 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:32.285604 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:32.286494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:32.292951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.293413 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.294265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.294714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.341628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.342092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.342721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lazy-loading 'fault' on Instance uuid d4e823ff-de17-4756-8990-8c2cdc9bd349 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:09:32.386700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea882dbe6dd54791938e3bafd74cdeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e5b26ca56447bdb1d7c4219d7c2598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:32.387082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:32.395275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e2062312-a5a9-4bd3-ab47-9683f6290dd1 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 200 len: 1312 microversion: 2.1 time: 0.113445 Jan 28 08:09:32.396147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-31d0ca04-57ec-4f84-8d98-372f76ac08e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.181159 Jan 28 08:09:32.401153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 342/671] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:32 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:32.405654 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 330/672] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:32 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:32.888383 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:32.889086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:32.895655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.896108 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:32.896931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:32.897366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.049291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:33.058332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:33.059879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:33.061029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-da1354f2-3b60-4072-83a1-80c1cec1051d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.176491 Jan 28 08:09:33.061576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 343/673] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:32 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:33.291561 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:33.292096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:33.298239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.298686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.299556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.299992 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.359142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf2c7ab19f374ad39a5c0f21e4e24835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d20a5061d447d29c55be6fddbd3b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:33.367255 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-21d4c987-e436-4977-b499-d815ca983a4a tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 200 len: 1301 microversion: 2.1 time: 0.079639 Jan 28 08:09:33.375150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 331/674] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:33 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:33.412838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:33.413458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] [instance: d4e823ff-de17-4756-8990-8c2cdc9bd349] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:33.417825 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:33.418445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:33.419762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.420394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.421933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.422385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.424476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.428776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.428776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.428776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.435767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] HTTP exception thrown: Instance d4e823ff-de17-4756-8990-8c2cdc9bd349 could not be found. Jan 28 08:09:33.436397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] Returning 404 to user: Instance d4e823ff-de17-4756-8990-8c2cdc9bd349 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:33.437227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-617e6df2-c36b-4120-a0de-4dd595dfc2e3 tempest-ServerRescueNegativeTestJSON-91851823 tempest-ServerRescueNegativeTestJSON-91851823-project] 10.222.0.42 "GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349" status: 404 len: 111 microversion: 2.1 time: 0.028626 Jan 28 08:09:33.437759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 344/675] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:33 2022] GET /compute/v2.1/servers/d4e823ff-de17-4756-8990-8c2cdc9bd349 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:09:33.498256 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-339468aa-affb-488d-802b-0ebddeee837f req-73631736-0a9c-4e23-842e-b314b12b8d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0612c4-618b-450a-a6dc-bd226fcde646", "name": "network-vif-deleted", "tag": "1758b189-1edc-4faa-9a0d-821aa50b7283"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:33.500082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:33.500082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:09:33.507412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-339468aa-affb-488d-802b-0ebddeee837f req-73631736-0a9c-4e23-842e-b314b12b8d70 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:33.507869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-339468aa-affb-488d-802b-0ebddeee837f req-73631736-0a9c-4e23-842e-b314b12b8d70 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:33.519417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-339468aa-affb-488d-802b-0ebddeee837f req-73631736-0a9c-4e23-842e-b314b12b8d70 service nova] Creating event network-vif-deleted:1758b189-1edc-4faa-9a0d-821aa50b7283 for instance cc0612c4-618b-450a-a6dc-bd226fcde646 on hv-cinder-80403 Jan 28 08:09:33.525111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-339468aa-affb-488d-802b-0ebddeee837f req-73631736-0a9c-4e23-842e-b314b12b8d70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030552 Jan 28 08:09:33.525748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 345/676] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:09:33.568816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:33.576580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b8754341-7761-4211-9582-93a89a2028bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.162670 Jan 28 08:09:33.577153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 332/677] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:33 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:34.080544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:34.081284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:34.088135 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.089140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.089952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.090467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.345313 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:34.354626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:34.356182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:34.357363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ded1ab28-242e-45fb-b08f-66f48f5f7898 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.281451 Jan 28 08:09:34.357915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 346/678] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:34 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:34.383438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:34.384062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] [instance: cc0612c4-618b-450a-a6dc-bd226fcde646] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:34.390562 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.391004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.391809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.392237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.405333 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] HTTP exception thrown: Instance cc0612c4-618b-450a-a6dc-bd226fcde646 could not be found. Jan 28 08:09:34.405919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] Returning 404 to user: Instance cc0612c4-618b-450a-a6dc-bd226fcde646 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:09:34.406756 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-87cbaa0d-189d-4c84-867e-ba17eac81fe2 tempest-AttachVolumeNegativeTest-868246474 tempest-AttachVolumeNegativeTest-868246474-project] 10.222.0.42 "GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646" status: 404 len: 111 microversion: 2.1 time: 0.027856 Jan 28 08:09:34.407311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 333/679] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:34 2022] GET /compute/v2.1/servers/cc0612c4-618b-450a-a6dc-bd226fcde646 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:09:34.593920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:34.594569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:34.601286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.601878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.602731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:34.603300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:34.788238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:34.796860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-340561e8-8e5e-4f90-96e6-7fb4521ab01d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.206565 Jan 28 08:09:34.797430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 347/680] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:34 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:35.378405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:35.379479 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:35.389882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:35.391050 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:35.392030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:35.393275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:35.607611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:35.616116 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:35.618681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:35.619881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0c479c2a-8194-4597-9e5e-6167f1a8ef5b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.247367 Jan 28 08:09:35.620441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 334/681] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:35 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:35.813616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:35.814282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:35.820670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:35.821128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:35.821919 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:35.822345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:35.983193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:35.991464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e16c4671-f556-4482-b54d-8d44dd0cc930 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.181373 Jan 28 08:09:35.992039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 348/682] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:35 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:36.638457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:36.639181 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:36.645623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:36.646069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:36.646837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:36.647386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:36.852997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:36.864666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:36.866864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:36.868182 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a5abb7cb-5c97-4e77-97c7-c915215f1373 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.233625 Jan 28 08:09:36.868741 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 335/683] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:36 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:37.010377 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:37.011143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:37.020277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:37.023505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:37.024471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:37.025976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:37.224961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:37.233608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a493bb74-05b5-4f28-b667-ab6d95d681d3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.227877 Jan 28 08:09:37.234170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 349/684] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:37 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:37.886664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:37.887140 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:37.893273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:37.893724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:37.894512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:37.894936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:38.096300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:38.104843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:38.106408 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:38.107964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ffbdd7c7-919a-4242-a9b9-87d02a9c9f74 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.225332 Jan 28 08:09:38.108532 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 336/685] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:37 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:38.249626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:38.250376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:38.257480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:38.258041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:38.258940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:38.259480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:38.388029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:38.396850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-602f03e9-a38c-4a78-82c5-b13363eb74a9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.150840 Jan 28 08:09:38.397536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 350/686] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:38 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:39.127471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:39.128096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:39.134970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:39.135449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:39.136230 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:39.136668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:39.276422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:39.285087 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:39.286768 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:39.288091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c0015421-ad3e-44b8-bd2d-1101bcb71f6d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.164696 Jan 28 08:09:39.291415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 337/687] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:39 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:39.413637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:39.414285 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:39.431526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:39.431526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:39.431526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:39.431526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:39.556364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:39.564159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-18c49c3c-52d0-4747-8e48-b4e1019f2ffa tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.154780 Jan 28 08:09:39.564756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 351/688] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:39 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:40.306568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:40.312049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:40.313990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:40.314396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:40.315183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:40.315824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:40.456548 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:40.468296 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:40.470065 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:40.471488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cb0110c0-45ad-4d5c-a1ce-bfbc9990c133 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.168575 Jan 28 08:09:40.480535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 338/689] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:40 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:40.580391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:40.581027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:40.587316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:40.587887 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:40.588641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:40.589024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:40.715235 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:40.723093 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-af88124e-b043-40a4-b156-cfa3e5ea8eee tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.146463 Jan 28 08:09:40.724253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 352/690] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:40 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:41.490308 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:41.490917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:41.497680 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:41.498130 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:41.498898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:41.499379 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:41.626083 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:41.633803 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:41.635347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:41.636491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bdccd2c2-02d9-4324-900b-9def617d6504 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.149923 Jan 28 08:09:41.637052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 339/691] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:41 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:41.740349 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:41.740970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:41.748996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:41.749455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:41.750243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:41.750682 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:41.886895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:41.894547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ce7b8885-3a0a-4be1-aba1-c9d28ab2eb95 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.158159 Jan 28 08:09:41.895671 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 353/692] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:41 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:42.121886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:09:42.122091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:09:42.654077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:42.654699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:42.661674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:42.662125 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:42.662907 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:42.663364 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:42.791714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:42.799656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:42.801266 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:42.802902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7db1ded9-3421-4a56-b045-46eebd086047 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.152529 Jan 28 08:09:42.803496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 340/693] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:42 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:42.912157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:42.912701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:42.919113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:42.919595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:42.920367 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:42.920810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:43.045656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:43.053918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dd86969c-730e-47a6-8b27-e29c862b486e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.145937 Jan 28 08:09:43.059491 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 354/694] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:42 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:43.820726 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:43.821274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:43.827506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:43.827958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:43.828724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:43.829156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:43.952129 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:43.960482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:43.961990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:43.963133 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5e31951a-0a0f-44ae-a866-22ecebb5e215 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.146276 Jan 28 08:09:43.963721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 341/695] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:43 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:44.069551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:44.070156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:44.076440 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:44.076828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:44.077593 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:44.078019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:44.207204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:44.215739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3d95e714-9064-4cb0-bcbe-866a61a7c65e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.149832 Jan 28 08:09:44.216310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 355/696] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:44 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:44.465701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-eb39f670-0977-4cc4-808e-ba2577303775 req-81727872-1d01-4219-837c-9879b88422fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "name": "network-vif-plugged", "status": "completed", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:44.467433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:09:44.467433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:09:44.474583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-eb39f670-0977-4cc4-808e-ba2577303775 req-81727872-1d01-4219-837c-9879b88422fa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:44.475029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-eb39f670-0977-4cc4-808e-ba2577303775 req-81727872-1d01-4219-837c-9879b88422fa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:44.485655 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-eb39f670-0977-4cc4-808e-ba2577303775 req-81727872-1d01-4219-837c-9879b88422fa service nova] Creating event network-vif-plugged:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:09:44.490762 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-eb39f670-0977-4cc4-808e-ba2577303775 req-81727872-1d01-4219-837c-9879b88422fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028727 Jan 28 08:09:44.491361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 342/697] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:09:44.981907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:44.982541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:44.988369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:44.989369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:44.990151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:44.990652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:45.141386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:45.149187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:45.151234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:45.151971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2937eba3-3e06-4e34-ad2e-1eff2ba54923 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.174047 Jan 28 08:09:45.152530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 356/698] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:44 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:45.233481 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:45.234225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:45.240829 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:45.241281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:45.242057 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:45.242497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:45.373808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:45.381660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d092104f-0b48-4641-8bb4-fec9ba6b1bf1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.152777 Jan 28 08:09:45.389658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 343/699] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:45 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:46.170255 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:46.171024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:46.177363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:46.177767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:46.178568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:46.179008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:46.354246 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:46.362015 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:46.363580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:46.364732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6add963e-9486-4d7c-9311-99f5c9ac4749 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.198425 Jan 28 08:09:46.365292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 357/700] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:46 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:46.399411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:46.401698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:46.406280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:46.406729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:46.407576 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:46.407970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:46.553069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:46.561351 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-01120ab9-1b6a-4b86-a1a4-066b21a1aeba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.166249 Jan 28 08:09:46.561930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 344/701] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:46 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:47.382458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:47.382989 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:47.389599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:47.390191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:47.390974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:47.391537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:47.534465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:47.543296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:47.544805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:47.545961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d97b4bae-cde7-41b7-b6bd-a319335603c1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1743 microversion: 2.20 time: 0.167322 Jan 28 08:09:47.546542 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 358/702] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:47 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:47.579067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:47.579718 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:47.587456 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:47.587906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:47.588863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:47.589302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:47.719104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:47.728252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4b69b067-4633-4483-80d2-44c49d51f468 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.152936 Jan 28 08:09:47.728942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 345/703] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:47 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:48.563811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:48.564423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:48.571424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:48.571874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:48.572685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:48.573122 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:48.699147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:48.707182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:48.708757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:48.709902 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-33f47947-ee9b-481c-8de6-8d56487cc162 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.149812 Jan 28 08:09:48.710463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 359/704] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:48 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:48.745425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:48.746039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:48.752649 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:48.753108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:48.753890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:48.754376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:48.886457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:48.894091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2c384dae-a53f-499e-bdb0-6adfc34dbfb4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.152318 Jan 28 08:09:48.894662 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 346/705] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:48 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:49.728708 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:49.729311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:49.735512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:49.740250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:49.740250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:49.740250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:49.867514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:49.875115 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:49.876646 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:49.877785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7574790f-ba23-4f6c-9815-06913f8683bc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.152824 Jan 28 08:09:49.878347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 360/706] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:49 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:49.911270 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:49.911910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:49.918408 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:49.918858 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:49.919660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:49.920096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:50.043581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:50.051235 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f0263680-e5f3-49a8-810e-67d212621250 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.144116 Jan 28 08:09:50.051838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 347/707] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:49 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:50.895679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:50.896293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:50.902439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:50.902887 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:50.903696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:50.904130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:51.029407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:51.037506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:51.039013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:51.040454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-216b8d0a-f074-42bf-87a8-b35bbf0139fc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.148207 Jan 28 08:09:51.041016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 361/708] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:50 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:51.067773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:51.068386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:51.074549 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:51.075004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:51.075816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:51.076257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:51.203653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:51.211526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7611b288-95ed-47dc-9d71-34fcc19e9353 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1723 microversion: 2.1 time: 0.147349 Jan 28 08:09:51.212097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 348/709] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:51 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:52.059975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:52.060655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:52.067604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:52.068062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:52.069038 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:52.069531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:52.215724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:52.224168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:52.229905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:52.231103 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:52.237684 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:52.238137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:52.239685 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:52.240959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-33dcfab7-5400-49d9-b8b2-18b9163b9637 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.184752 Jan 28 08:09:52.241533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 362/710] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:52 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:52.242019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:52.242778 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:52.398722 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:52.406482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d9c83b41-2de5-40f8-a74a-79912424ca33 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1700 microversion: 2.1 time: 0.180147 Jan 28 08:09:52.407070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 349/711] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:52 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1700 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:09:52.425590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-82060818-4fe3-4823-b5e4-e4753bfd96db tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:09:52.432610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-82060818-4fe3-4823-b5e4-e4753bfd96db tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:52.433276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-82060818-4fe3-4823-b5e4-e4753bfd96db tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:52.495358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-82060818-4fe3-4823-b5e4-e4753bfd96db tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Going to try to start instance {{(pid=116947) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 08:09:53.062075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-82060818-4fe3-4823-b5e4-e4753bfd96db tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 202 len: 0 microversion: 2.1 time: 0.293942 Jan 28 08:09:53.062075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 363/712] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:09:52 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:09:53.064001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:53.064001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:53.064001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.064001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:53.064425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.064425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:53.064425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:53.064690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8645ae78-eac2-470c-95fb-53a0de389908 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.167483 Jan 28 08:09:53.064690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 350/713] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:52 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:53.261361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:53.262300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:53.269165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.269665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:53.270627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.271221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:53.420380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:53.429970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:53.431548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:53.432728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-47a08965-227e-4459-b4fc-f3409b09627d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.175902 Jan 28 08:09:53.433329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 364/714] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:53 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:53.906713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:53.907517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:53.914587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.915605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:53.916621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:53.917362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:54.066344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:54.078851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ae697d1f-d6fc-4447-9bef-897b40f1f946 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.177295 Jan 28 08:09:54.079770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 351/715] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:53 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:54.451271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:54.451929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:54.458210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:54.458662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:54.459472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:54.459911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:54.600638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:54.608898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:54.610399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:54.614210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f3b39fe8-6122-4417-b2f0-29184881aeb7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.165995 Jan 28 08:09:54.614984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 365/716] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:54 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:55.096455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:55.097713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:55.104636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:55.105305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:55.106303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:55.106746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:55.249614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:55.262040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f8faac20-bcce-4fbe-9397-5b4be334ddd9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.169231 Jan 28 08:09:55.263185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 352/717] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:55 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:55.632830 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:55.633699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:55.640513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:55.641087 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:55.641946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:55.642530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:55.812558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:55.823474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:55.825271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:55.826622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4e85c720-922e-414b-bf84-a141cb9663c0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.197714 Jan 28 08:09:55.827183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 366/718] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:55 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:56.281119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:56.282097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:56.291491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:56.292365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:56.293341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:56.293967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:56.525823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:56.536487 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2feb3e99-4b20-49e6-9f26-730f144c8cdc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.259324 Jan 28 08:09:56.537077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 353/719] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:56 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:56.846442 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:56.847092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:56.857459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:56.868284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:56.868284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:56.868284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:57.014924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:57.028166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:57.029672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:57.030934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d7aa84e8-03a4-4533-999f-bdf1e010918a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.189470 Jan 28 08:09:57.032706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 367/720] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:56 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:57.555899 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:57.556512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:57.563729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:57.564410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:57.565552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:57.566040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:57.718875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:57.728527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ebd7bec1-184a-4839-a6e1-a86912e08b80 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.178029 Jan 28 08:09:57.731787 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 354/721] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:57 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:58.049859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:58.050615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:58.057596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:58.058044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:58.058823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:58.059273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:58.335323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:58.335323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:58.336194 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:58.336194 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4e4a840d-d300-4928-a243-1595b0e97cb9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.155264 Jan 28 08:09:58.336194 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 368/722] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:58 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:58.745482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:58.746096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:58.752399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:58.752856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:58.753643 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:58.754583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:58.893459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:58.904432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-93ae9bcb-a510-4cbe-afed-0e667f697970 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.162584 Jan 28 08:09:58.905820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 355/723] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:58 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:09:59.357133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:59.358376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:59.365377 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:59.366054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:59.367113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:59.367721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:59.544811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:59.553958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:59.558613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:09:59.561906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1f096600-6a1d-49ee-89a9-61ecd7a794aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.214029 Jan 28 08:09:59.562745 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 369/724] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:09:59 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:09:59.921813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:09:59.922418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:09:59.929611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:59.930066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:09:59.930834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:09:59.931467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:00.081359 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:00.089512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0b8f96d3-e7a5-4b23-87f9-bae5a221d06a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.171441 Jan 28 08:10:00.090527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 356/725] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:09:59 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:00.583969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:00.585150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:00.592237 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:00.592967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:00.594005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:00.594534 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:00.727164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:00.735353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:00.736859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:00.738003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fb1bed2a-d088-4d5e-9091-4650aa9788df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.157918 Jan 28 08:10:00.744347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 370/726] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:00 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:01.107108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:01.108000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:01.114720 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:01.115325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:01.116375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:01.116919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:01.255778 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:01.263725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-82dac69c-17fa-498b-a29e-277a68753bb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.160485 Jan 28 08:10:01.264292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 357/727] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:01 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:01.757585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:01.758457 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:01.765648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:01.766102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:01.766883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:01.767360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:01.910541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:01.918430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:01.919984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:01.921119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-becafff5-da24-43ea-b0b5-16b3ab249bd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.167819 Jan 28 08:10:01.921672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 371/728] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:01 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:02.281287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:02.281906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:02.288846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:02.289303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:02.290331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:02.290773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:02.420406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:02.428884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd72fcd6-44ef-4a3c-baf2-7a32425e57e5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1709 microversion: 2.1 time: 0.151360 Jan 28 08:10:02.429449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 358/729] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:02 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:02.939863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:02.941056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:02.947880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:02.948716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:02.949997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:02.950642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:03.093471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:03.102211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:03.103797 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:03.105039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7565686a-ce04-4544-a9c3-1636b3a05eea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.169469 Jan 28 08:10:03.105655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 372/730] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:02 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:03.446282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:03.446798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:03.452603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:03.453045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:03.453861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:03.454285 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:03.589158 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:03.597058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d9fd5098-c7ba-4605-82ed-5d1ec6fb80b2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1713 microversion: 2.1 time: 0.155248 Jan 28 08:10:03.598274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 359/731] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:03 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:04.127782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:04.128531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:04.135788 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:04.136298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:04.137023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:04.137456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:04.269160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:04.277208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:04.278785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:04.279959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9e02efec-8f8d-47d4-89af-c51a2d9bb00a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1738 microversion: 2.20 time: 0.156073 Jan 28 08:10:04.280524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 373/732] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:04 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:05.298117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:05.298752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:05.305079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:05.305527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:05.306299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:05.306776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:05.438941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:05.447664 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:05.449199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:05.450368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-94d010b6-ca42-4341-8c40-d09cac1db4d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1720 microversion: 2.20 time: 0.155920 Jan 28 08:10:05.450928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 360/733] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:05 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:06.469311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:06.469925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:06.477058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:06.477508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:06.478285 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:06.478726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:06.617784 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:06.625509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:06.627016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:06.628175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-777f98cb-f9ae-4b98-832d-847c0e10d601 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1720 microversion: 2.20 time: 0.162592 Jan 28 08:10:06.628738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 374/734] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:06 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:06.850037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:06.850530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:06.857401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:06.860888 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:06.862368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:06.863955 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:06.972911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lazy-loading 'services' on Instance uuid 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:10:07.293619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-94a695ad-fb28-4406-b1d4-b7db24279224 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1/os-volume_attachments/9d7f05bf-ba00-47a1-9c6a-db55d8b51f3a" status: 202 len: 0 microversion: 2.1 time: 0.446675 Jan 28 08:10:07.294434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 361/735] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:10:06 2022] DELETE /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1/os-volume_attachments/9d7f05bf-ba00-47a1-9c6a-db55d8b51f3a => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:10:07.645809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:07.646452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:07.652740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:07.653203 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:07.654012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:07.654518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:07.784820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:07.793343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:07.808103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:07.808103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-16b82cba-a9b7-4928-b969-b9156b9ac735 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1723 microversion: 2.20 time: 0.154043 Jan 28 08:10:07.808103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 375/736] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:07 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:07.814508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9109dbe8-3c31-4bd1-b366-f2126265ad28"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:07.815730 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:07.822012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:07.822462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:07.823234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:07.823702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:07.955810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-95ee6146-7245-41fa-843b-d2302c2b8a9a req-521d9399-edea-4f86-ab89-75f624f4ab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "name": "network-vif-unplugged", "status": "completed", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:07.958224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:10:07.958224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:10:07.964924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-95ee6146-7245-41fa-843b-d2302c2b8a9a req-521d9399-edea-4f86-ab89-75f624f4ab00 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:07.965363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-95ee6146-7245-41fa-843b-d2302c2b8a9a req-521d9399-edea-4f86-ab89-75f624f4ab00 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:07.976464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-95ee6146-7245-41fa-843b-d2302c2b8a9a req-521d9399-edea-4f86-ab89-75f624f4ab00 service nova] Creating event network-vif-unplugged:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:10:07.981333 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-95ee6146-7245-41fa-843b-d2302c2b8a9a req-521d9399-edea-4f86-ab89-75f624f4ab00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029153 Jan 28 08:10:07.982223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 376/737] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:10:09.183316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c860da8b-1680-4a9d-86f7-7ac2030bb6a1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.372761 Jan 28 08:10:09.184280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 362/738] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jan 28 08:10:07 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments => generated 188 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:10:09.293678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:09.294376 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:09.300615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.301590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.302415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.302847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.538461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:09.538992 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:09.545290 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.545750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.546542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.546981 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.575135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:10:09.601016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-40dab34d-e76f-4302-86ca-aa8dfcb79fca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action" status: 202 len: 0 microversion: 2.20 time: 0.312237 Jan 28 08:10:09.602530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 377/739] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:10:09 2022] POST /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:10:09.610460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:09.611074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:09.619051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.619892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.621547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.621547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.749492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:09.758318 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:09.759860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:09.761002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-964cd76d-515d-4b6f-899d-0b0caeec71b9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1749 microversion: 2.20 time: 0.154432 Jan 28 08:10:09.761560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 378/740] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:09 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:09.972704 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d967902b-3b8e-413e-aa7b-ac5274563e78 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 204 len: 0 microversion: 2.1 time: 0.438256 Jan 28 08:10:09.973375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 363/741] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:10:09 2022] DELETE /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 08:10:09.981159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:09.981811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:09.987516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.999427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:09.999427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:09.999427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:10.122041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:10.129934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-822b67aa-e306-41e6-b0dd-10f798ac702e tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1511 microversion: 2.1 time: 0.152320 Jan 28 08:10:10.130538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 379/742] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:09 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:10.780702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:10.781478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:10.788040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:10.788527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:10.789304 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:10.790007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:11.147816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:11.148433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:11.151354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:11.155054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:11.155556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:11.156341 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:11.156960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:11.161175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:11.163336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:11.164944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fb8bef99-39b0-479e-9450-edeffc256683 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1749 microversion: 2.20 time: 0.388634 Jan 28 08:10:11.165596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 364/743] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:10 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1749 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:11.293282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:11.293282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8648fcd0-0f8e-4a06-8a42-40f764d4896c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1511 microversion: 2.1 time: 0.149133 Jan 28 08:10:11.293448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 380/744] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:11 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:10:12.182719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:12.183269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:12.189781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:12.190239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:12.191021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:12.191499 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:12.324647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:12.326432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:12.335079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:12.335592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:12.336594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:12.337102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:12.414033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:12.426830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:12.428681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:12.430345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8bfb5dc5-7367-48f5-a8e1-163dce90e066 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1751 microversion: 2.20 time: 0.251388 Jan 28 08:10:12.436244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 365/745] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:12 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:12.477996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:12.488906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-10f29a9c-c30a-497f-98d9-0b035f248ffc tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1511 microversion: 2.1 time: 0.182557 Jan 28 08:10:12.498299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 381/746] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:12 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:10:12.712178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-29853806-f1b3-4e03-b34c-f1ee73f8c454 req-a73457db-4b94-4613-a64b-cf0599c7983b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3c2928-f7b0-4653-af54-0f776c2cd0b1", "name": "network-vif-deleted", "tag": "0e912ecb-28e4-404c-b81f-04816b4beb29"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:12.713776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:10:12.713776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:10:12.720841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-29853806-f1b3-4e03-b34c-f1ee73f8c454 req-a73457db-4b94-4613-a64b-cf0599c7983b service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:12.721283 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-29853806-f1b3-4e03-b34c-f1ee73f8c454 req-a73457db-4b94-4613-a64b-cf0599c7983b service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:12.731555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-29853806-f1b3-4e03-b34c-f1ee73f8c454 req-a73457db-4b94-4613-a64b-cf0599c7983b service nova] Creating event network-vif-deleted:0e912ecb-28e4-404c-b81f-04816b4beb29 for instance 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 on hv-cinder-80403 Jan 28 08:10:12.736288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-29853806-f1b3-4e03-b34c-f1ee73f8c454 req-a73457db-4b94-4613-a64b-cf0599c7983b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028981 Jan 28 08:10:12.736871 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 366/747] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:10:13.451142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:13.451796 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:13.458077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:13.458527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:13.459331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:13.459769 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:13.506668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:13.507434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:13.515180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:13.515958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:13.516970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:13.517343 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:13.552506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:13.553103 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:13.553630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lazy-loading 'fault' on Instance uuid 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:10:13.593716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:13.601673 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2e120cd8-8c0b-4a16-8c4b-aa0ff16f2467 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 200 len: 1308 microversion: 2.1 time: 0.099422 Jan 28 08:10:13.602295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 367/748] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:13 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:10:13.610317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:13.619214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:13.620745 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:13.621898 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-86a9ce16-dea6-48b9-b048-2b85e8cc28e3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1751 microversion: 2.20 time: 0.177072 Jan 28 08:10:13.622451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 382/749] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:13 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:14.620457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:14.621088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: 4f3c2928-f7b0-4653-af54-0f776c2cd0b1] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:14.628037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:14.628484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:14.629259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:14.630366 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:14.640122 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:14.640734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:14.655517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] HTTP exception thrown: Instance 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 could not be found. Jan 28 08:10:14.655517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Returning 404 to user: Instance 4f3c2928-f7b0-4653-af54-0f776c2cd0b1 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:10:14.655517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9be667c5-cd0a-4066-9aa5-8c0ed4e9e34b tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1" status: 404 len: 111 microversion: 2.1 time: 0.029742 Jan 28 08:10:14.655918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:14.656073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 368/750] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:14 2022] GET /compute/v2.1/servers/4f3c2928-f7b0-4653-af54-0f776c2cd0b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:10:14.656165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:14.656165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:14.656165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:14.788996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:14.797938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:14.799480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:14.800671 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8d82a9ce-83d7-4f5c-a16a-b29ff5c718e7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.164339 Jan 28 08:10:14.801151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 383/751] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:14 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:15.821941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:15.823214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:15.830259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:15.830937 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:15.832014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:15.832698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:15.986459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:16.000021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:16.002022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:16.003712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-90156396-7367-44b3-8075-ce820cee373a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.187662 Jan 28 08:10:16.004354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 369/752] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:15 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:17.022585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:17.024148 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:17.032222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:17.033218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:17.034172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:17.034674 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:17.194314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:17.204554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:17.206076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:17.207269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-93dff27a-95af-4033-82f7-22f4b81beedb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.188395 Jan 28 08:10:17.207864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 384/753] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:17 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:18.225527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:18.226066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:18.232421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:18.232874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:18.233650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:18.234088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:18.365556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:18.373769 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:18.375298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:18.376490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f2c8b0bb-b301-4673-be7d-287d6ff4b392 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.154825 Jan 28 08:10:18.377057 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 370/754] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:18 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:19.395014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:19.395664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:19.402787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:19.403958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:19.404798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:19.405257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:19.554993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:19.563333 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:19.564910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:19.566041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dfb08675-21d7-470c-8573-72c5918e5112 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.174779 Jan 28 08:10:19.566592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 385/755] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:19 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:20.586258 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:20.587617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:20.594054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:20.594497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:20.595290 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:20.595720 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:20.737749 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:20.746552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:20.748146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:20.749306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-acd26855-fb15-46fe-878c-8190bab496d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.168438 Jan 28 08:10:20.751461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 371/756] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:20 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:21.768994 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:21.769633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:21.776629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:21.777082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:21.777856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:21.778301 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:21.908915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:21.918335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:21.919912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:21.921142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6a0e7102-2782-495e-aef4-86434e10840c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.155875 Jan 28 08:10:21.921703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 386/757] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:21 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:22.939164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:22.939805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:22.946000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:22.946447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:22.947213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:22.947680 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:23.081204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:23.089628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:23.091204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:23.092686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9ccd29ec-fa38-453f-a917-731bd73dfa63 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.157053 Jan 28 08:10:23.093331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 372/758] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:22 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:24.111107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:24.122224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:24.126495 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:24.127310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:24.129589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:24.129589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:24.280870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:24.291433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:24.292973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:24.294189 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14f21914-795b-4814-9349-61ae74590567 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.187094 Jan 28 08:10:24.294859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 387/759] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:24 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:25.316305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:25.316305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:25.331208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:25.331694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:25.332502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:25.332936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:25.493080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:25.501721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:25.503543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:25.504876 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7793e05e-ea40-47b5-b28a-358d9108a6b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.194800 Jan 28 08:10:25.516940 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 373/760] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:25 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:26.524331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:26.524933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:26.531081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:26.531556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:26.532321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:26.532748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:26.665190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:26.673211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:26.674709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:26.675880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e75eefa4-a62b-4f40-8ccb-a586ad3a074e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.155925 Jan 28 08:10:26.676430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 388/761] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:26 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:27.694043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:27.694674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:27.701326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:27.701776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:27.702559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:27.702993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:27.835018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:27.843907 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:27.845446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:27.846573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f47b3798-041b-4d05-aaf1-cbd902adfb65 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.156367 Jan 28 08:10:27.847545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 374/762] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:27 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:28.865144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:28.865760 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:28.872152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:28.872605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:28.873378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:28.873815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:28.998025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:29.006216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:29.008250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:29.009401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d8fc2bd8-7d9e-4d59-a4df-1825be3a4d72 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.148017 Jan 28 08:10:29.009966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 389/763] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:28 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:30.027583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:30.028197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:30.034580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:30.035039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:30.035851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:30.036294 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:30.163097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:30.172100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:30.173611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:30.174752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e1d38194-4ffe-47c0-9e66-365da0ac729b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.150927 Jan 28 08:10:30.175344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 375/764] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:30 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:31.192667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:31.193309 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:31.199567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:31.200017 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:31.200787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:31.201240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:31.325699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:31.333849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:31.335892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:31.337037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a2cb1fd8-3265-4d1a-a643-29f8a03e3a77 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.148082 Jan 28 08:10:31.337598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 390/765] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:31 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:31.615384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-878806094", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "7cff128e-ba62-4803-9f9b-57d2ce420c02"}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:31.665398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] validate_networks() for [('7cff128e-ba62-4803-9f9b-57d2ce420c02', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:10:31.997872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:10:31.998295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:10:31.998769 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:10:31.999177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:10:31.999615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:10:32.008626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:32.009072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:32.009875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:32.010310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:32.026581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Getting quotas for project b4caadfc3fd847008ba57fe5fc8d82a5. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:10:32.030476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Getting quotas for user 8b1922f9b5df450b88e0183cb6dc1419 and project b4caadfc3fd847008ba57fe5fc8d82a5. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:10:32.041206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:10:32.043471 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:10:32.208442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [652f1179-7417-4d52-9ff9-a3fbd1d10a4a] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 08:10:32.354939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:32.355681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:32.361936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:32.362386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:32.363162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:32.363627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:32.494568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:32.502815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:32.504353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:32.505489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cc9519e8-fac3-4096-ae83-83070c57cbfd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.154304 Jan 28 08:10:32.506054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 391/766] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:32 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:33.218203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [652f1179-7417-4d52-9ff9-a3fbd1d10a4a] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42988. Jan 28 08:10:33.221954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-35017950-9a7e-4687-b2d1-36a4e21f3f02 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610276 Jan 28 08:10:33.222591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 376/767] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:10:33.232905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f682d7be-ae91-40b8-994b-9d2cecbc5377 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:33.233461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f682d7be-ae91-40b8-994b-9d2cecbc5377 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:33.282420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f682d7be-ae91-40b8-994b-9d2cecbc5377 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:33.289073 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f682d7be-ae91-40b8-994b-9d2cecbc5377 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1218 microversion: 2.1 time: 0.060433 Jan 28 08:10:33.289929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 392/768] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:33 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:33.524278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:33.524892 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:33.530930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:33.531431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:33.532206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:33.532647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:33.659609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:33.669436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:33.671941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:33.673743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6e5d45e0-5882-49c7-ba4d-eaf2ae80c990 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.153731 Jan 28 08:10:33.674569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 377/769] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:33 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:34.306079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:34.306701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:34.313106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:34.313560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:34.314348 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:34.314786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:34.373640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:34.380729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-57d547b8-df84-4abf-8d5b-0d89b8e4b91f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1222 microversion: 2.1 time: 0.078826 Jan 28 08:10:34.381296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 393/770] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:34 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:34.698435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:34.699001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:34.705426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:34.705883 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:34.706728 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:34.707110 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:34.840711 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:34.848918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:34.850414 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:34.851574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-868c2343-c5f9-44ff-84fb-a756c2f241de tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.157604 Jan 28 08:10:34.852696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 378/771] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:34 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:35.397661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:35.398275 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:35.404571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:35.405021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:35.405797 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:35.406232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:35.463847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:35.471030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a2456aaf-3fa9-47a1-8b13-95a19b87c6e9 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1270 microversion: 2.1 time: 0.076897 Jan 28 08:10:35.471633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 394/772] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:35 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1270 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:35.870847 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:35.871497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:35.877702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:35.878155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:35.878926 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:35.879399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:36.008618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:36.016918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:36.018375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:36.019555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b060014a-df49-4ea7-b516-1ae5bad0da4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.153049 Jan 28 08:10:36.020118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 379/773] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:35 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:36.487634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:36.488364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:36.495432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:36.495894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:36.496678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:36.497199 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:36.555510 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:36.562632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e0013ba6-b6c0-4f7d-9e45-35c3d08d2971 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1278 microversion: 2.1 time: 0.078820 Jan 28 08:10:36.563143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 395/774] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:36 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:37.038302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:37.039617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:37.045921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:37.046379 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:37.049646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:37.049646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:37.181779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:37.194372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:37.195033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:37.196834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-692c34e5-7c43-4d95-846e-cf61e474468b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.162713 Jan 28 08:10:37.197398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 380/775] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:37 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:37.579020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:37.579666 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:37.585918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:37.586371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:37.587136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:37.587587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:37.647538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:37.654698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-61d78b03-8553-488f-8cab-edb3cb09cf41 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1278 microversion: 2.1 time: 0.079361 Jan 28 08:10:37.655271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 396/776] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:37 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:38.215959 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:38.216564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:38.222764 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:38.223213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:38.224014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:38.224458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:38.354467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:38.362645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:38.364183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:38.365320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a728dcb2-1410-4b0a-8499-f5f9ebe7b349 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.153105 Jan 28 08:10:38.365886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 381/777] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:38 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:38.670700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:38.671329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:38.677462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:38.677906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:38.678669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:38.679134 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:38.735671 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:38.742717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-24221f60-d2ae-40d2-b192-7f1985e56bef tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1278 microversion: 2.1 time: 0.075657 Jan 28 08:10:38.743286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 397/778] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:38 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1278 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:39.383911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:39.384540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:39.390807 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:39.391275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:39.392063 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:39.392495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:39.534767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:39.543773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:39.545311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:39.546445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b86b6de4-f759-4c36-a60a-436e86466bea tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.166316 Jan 28 08:10:39.547004 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 382/779] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:39 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:39.759074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:39.759820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:39.766066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:39.766565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:39.767457 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:39.767891 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:39.826172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:39.833441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bfce648c-b571-45ac-9450-720318281dda tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1276 microversion: 2.1 time: 0.078119 Jan 28 08:10:39.833941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 398/780] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:39 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1276 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:40.564964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:40.565675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:40.572805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:40.573252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:40.574029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:40.574467 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:40.807998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:40.816302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:40.817815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:40.818956 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d7efd85e-41a0-465f-b8f0-de41ee07bd93 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.257807 Jan 28 08:10:40.819587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 383/781] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:40 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:40.849704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:40.850312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:40.857229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:40.857928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:40.858716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:40.859155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:40.987883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:40.996606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9ba4dbc0-f02d-4b86-983d-e0d411a2671f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.150625 Jan 28 08:10:41.003097 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 399/782] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:40 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:41.012677 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-db19642d-4b56-4d9e-b6fb-2ed100268e5e req-e61e19ec-2be9-4ca7-b8a5-d946f865f92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9052190-80be-4c55-92b8-d13dcaa2a40e", "tag": "57cb1810-885e-4e06-9669-067bd53f4040"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:41.014264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:10:41.014264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:10:41.021178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-db19642d-4b56-4d9e-b6fb-2ed100268e5e req-e61e19ec-2be9-4ca7-b8a5-d946f865f92d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:41.021714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-db19642d-4b56-4d9e-b6fb-2ed100268e5e req-e61e19ec-2be9-4ca7-b8a5-d946f865f92d service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:41.033588 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-db19642d-4b56-4d9e-b6fb-2ed100268e5e req-e61e19ec-2be9-4ca7-b8a5-d946f865f92d service nova] Creating event network-changed:57cb1810-885e-4e06-9669-067bd53f4040 for instance b9052190-80be-4c55-92b8-d13dcaa2a40e on hv-cinder-80403 Jan 28 08:10:41.038634 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-db19642d-4b56-4d9e-b6fb-2ed100268e5e req-e61e19ec-2be9-4ca7-b8a5-d946f865f92d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029519 Jan 28 08:10:41.040037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 384/783] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:10:41.836525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:41.837079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:41.842874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:41.843358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:41.844132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:41.844568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:41.971144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:41.979348 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:41.980880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:41.982025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-aad97d53-8f15-4556-89a3-3b1b9da3fd6f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.149317 Jan 28 08:10:41.982578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 400/784] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:41 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:42.014103 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:42.014793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:42.021207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:42.021678 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:42.022435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:42.022862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:42.146341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:42.153433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a83f55a2-6733-4ad5-8016-7d9d85855601 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.143305 Jan 28 08:10:42.153999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 385/785] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:42 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:43.000815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:43.001432 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:43.008201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:43.008661 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:43.009436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:43.009872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:43.132587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:43.141240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:43.142750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:43.143934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f9ce27c5-13a0-462e-99d9-78a5c1149b26 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.146844 Jan 28 08:10:43.144501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 401/786] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:42 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:43.170793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:43.171474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:43.177584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:43.178014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:43.178777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:43.179210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:43.306446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:43.313725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c26d8655-5fa6-4fd2-a363-6cc953cc8dc5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.147239 Jan 28 08:10:43.314298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 386/787] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:43 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:44.162684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:44.163200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:44.170360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:44.170818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:44.171611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:44.172046 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:44.300303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:44.308452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:44.309972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:44.311119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2a1d1692-0ee6-4ffd-98d6-656c0fa62282 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.152260 Jan 28 08:10:44.311724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 402/788] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:44 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:44.330752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:44.331442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:44.338366 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:44.338822 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:44.339627 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:44.340072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:44.548387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:44.555510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b969500b-b83b-41f4-b952-c1adb2dfb071 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.228500 Jan 28 08:10:44.556326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 387/789] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:44 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:45.328762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:45.329277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:45.335624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:45.336096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:45.336927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:45.337792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:45.471162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:45.479946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:45.481462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:45.482622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-79a2fb40-c006-4455-aec9-0c08dd67f796 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.157745 Jan 28 08:10:45.483185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 403/790] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:45 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:45.572340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:45.572951 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:45.579073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:45.579571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:45.580344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:45.580779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:45.707974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:45.715066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-71786ad1-e9a5-48be-9a28-82b26448f062 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.146939 Jan 28 08:10:45.715695 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 388/791] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:45 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:46.500257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:46.501847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:46.509152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:46.509676 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:46.510727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:46.511130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:46.642615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:46.651677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:46.653191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:46.654535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5e54da0e-0268-4af1-9f89-b1ade3bc50aa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.158505 Jan 28 08:10:46.655138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 404/792] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:46 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:46.731228 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:46.731788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:46.738818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:46.739480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:46.740840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:46.740840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:46.929250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:46.937582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ba24f354-2b94-4797-adf0-e6a3d85c08eb tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.210353 Jan 28 08:10:46.938228 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 389/793] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:46 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:47.673502 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:47.674255 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:47.681202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:47.681657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:47.682430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:47.682868 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:47.822576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:47.830765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:47.832292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:47.833434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fcbf53d6-0aa8-48ed-9ca0-bc7f4bdd2ea3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.163673 Jan 28 08:10:47.833994 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 405/794] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:47 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:47.954612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:47.955395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:47.962234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:47.962687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:47.963521 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:47.963960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:48.105999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:48.113334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ba1d5375-f720-4f51-8acd-80481b2828b5 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.162512 Jan 28 08:10:48.113895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 390/795] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:47 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:48.851378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:48.852676 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:48.859003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:48.859493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:48.860277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:48.860712 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:48.989077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:48.997911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:48.999452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:49.000606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-27fea142-84b5-4f44-a747-f940a9f32828 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.152856 Jan 28 08:10:49.001279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 406/796] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:48 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:49.129558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:49.130167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:49.136550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:49.136992 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:49.137767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:49.138195 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:49.284733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:49.293188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-04074880-3b46-4177-973a-d2222267d9d7 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.167225 Jan 28 08:10:49.293952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 391/797] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:49 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:50.019021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:50.019659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:50.026571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:50.027043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:50.027859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:50.028578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:50.171353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:50.179591 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:50.181571 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:50.182702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dc35e549-8a34-48d7-b6a7-19e714b523f5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.167387 Jan 28 08:10:50.183279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 407/798] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:50 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:50.310205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:50.310931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:50.317029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:50.317524 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:50.318300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:50.318750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:50.453219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:50.460623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ccef13fc-a296-43c6-b67e-d95142aec670 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.153967 Jan 28 08:10:50.461563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 392/799] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:50 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:10:50.495446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-bdfe440c-0269-434f-bf9e-0dbb7cdecbd2 req-d2ade8d5-b874-418a-b710-5cf59da2589a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "name": "network-vif-plugged", "status": "completed", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:50.497112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:10:50.497112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:10:50.503956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-bdfe440c-0269-434f-bf9e-0dbb7cdecbd2 req-d2ade8d5-b874-418a-b710-5cf59da2589a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:50.504408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-bdfe440c-0269-434f-bf9e-0dbb7cdecbd2 req-d2ade8d5-b874-418a-b710-5cf59da2589a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:50.520493 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-bdfe440c-0269-434f-bf9e-0dbb7cdecbd2 req-d2ade8d5-b874-418a-b710-5cf59da2589a service nova] Creating event network-vif-plugged:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:10:50.523720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-bdfe440c-0269-434f-bf9e-0dbb7cdecbd2 req-d2ade8d5-b874-418a-b710-5cf59da2589a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Jan 28 08:10:50.524452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 408/800] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:10:51.201494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:51.202077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:51.208026 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:51.208486 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:51.209253 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:51.209691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:51.340164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:51.348306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:51.349818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:51.351124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-90b234a6-b062-4565-bccf-aa4547230677 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.153424 Jan 28 08:10:51.363376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 393/801] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:51 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:51.478784 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:51.479554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:51.486727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:51.489270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:51.489270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:51.489270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:51.633182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:51.637359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-92d0e71f-9783-42d9-a5a5-5cef09f3f04f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.163176 Jan 28 08:10:51.638043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 409/802] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:51 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:52.370435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:52.371050 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:52.377505 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:52.377960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:52.378732 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:52.379171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:52.513104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:52.521301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:52.528611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:52.528611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ff784c69-d1a4-42fb-b634-e2009b05e62f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.157887 Jan 28 08:10:52.528611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 394/803] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:52 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:52.537942 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-a2a7df7c-6c6f-410b-8103-31e7d6bc35ae req-cf569630-cc1b-4276-afbc-70b557e3ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9052190-80be-4c55-92b8-d13dcaa2a40e", "name": "network-vif-plugged", "status": "completed", "tag": "57cb1810-885e-4e06-9669-067bd53f4040"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:52.539849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:10:52.539849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:10:52.546962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-a2a7df7c-6c6f-410b-8103-31e7d6bc35ae req-cf569630-cc1b-4276-afbc-70b557e3ea84 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:52.547434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-a2a7df7c-6c6f-410b-8103-31e7d6bc35ae req-cf569630-cc1b-4276-afbc-70b557e3ea84 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:52.558186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-a2a7df7c-6c6f-410b-8103-31e7d6bc35ae req-cf569630-cc1b-4276-afbc-70b557e3ea84 service nova] Creating event network-vif-plugged:57cb1810-885e-4e06-9669-067bd53f4040 for instance b9052190-80be-4c55-92b8-d13dcaa2a40e on hv-cinder-80403 Jan 28 08:10:52.562754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-a2a7df7c-6c6f-410b-8103-31e7d6bc35ae req-cf569630-cc1b-4276-afbc-70b557e3ea84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028378 Jan 28 08:10:52.563372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 410/804] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:10:52.653567 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:52.654215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:52.660037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:52.660476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:52.661238 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:52.661666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:52.789997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:52.797625 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7d8dbf6d-ffb3-494f-8292-415f4c1f1f6d tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.147676 Jan 28 08:10:52.798200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 395/805] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:52 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:53.542976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:53.543737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:53.550199 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:53.550651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:53.551450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:53.551881 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:53.688708 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:53.696953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:53.698458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:53.699637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4596d00e-4297-461f-ab4c-be894b46408d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.160899 Jan 28 08:10:53.700191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 411/806] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:53 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:10:53.816999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:53.817613 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:53.823925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:53.824369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:53.825135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:53.825569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:53.952550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:53.959736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ab60f343-714d-409d-ba1f-41c14e4af058 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1318 microversion: 2.1 time: 0.146406 Jan 28 08:10:53.960300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 396/807] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:53 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:54.717525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:54.718132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:54.724587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:54.725034 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:54.725803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:54.726235 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:54.853716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:54.862014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:54.863561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:54.864707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e771eec1-bcba-4076-94d8-741e63fd9d40 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1807 microversion: 2.20 time: 0.150915 Jan 28 08:10:54.865264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 412/808] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:54 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:10:54.975659 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:54.976278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:54.983065 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:54.983563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:54.984338 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:54.984779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:55.120051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:55.127266 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5a3e5d9a-9c5e-4afd-b5d9-b471c4d30c9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1505 microversion: 2.1 time: 0.155248 Jan 28 08:10:55.127834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 397/809] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:10:54 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:10:55.143117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf4d7de-9eb8-440a-a3bf-d3cf5b44fae6", "device": "/dev/sdb"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:10:55.144691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:55.150446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:55.150897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:55.151729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:55.152176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:55.882504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:10:55.883127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:10:55.890118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:55.890574 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:55.891398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:10:55.891878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:10:56.025951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e494f225-711e-4147-ad46-aea24dba9088 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "POST /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.885624 Jan 28 08:10:56.026575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 413/810] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:10:55 2022] POST /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:10:56.034325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:56.043636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:56.047595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:10:56.050330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0c0f76f6-ade7-40ef-a096-9172f9750705 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1794 microversion: 2.20 time: 0.171460 Jan 28 08:10:56.051301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 398/811] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:10:55 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1794 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:11:10.598835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-67361432", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:10.805897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] validate_networks() for None {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:11:11.070699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:11:11.071126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:11:11.075283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:11:11.075283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:11:11.075283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:11:11.081436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:11.081887 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:11.082703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:11.083142 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:11.099631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Getting quotas for project 696d6da9391d4c4ebd7ffdbffa4dff42. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:11:11.103548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Getting quotas for user 8da32e6324514064853a8b6cfd8f5ce6 and project 696d6da9391d4c4ebd7ffdbffa4dff42. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:11:11.114652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:11:11.117069 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:11:11.247942 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fc396d23-a8c8-4d7c-9d3e-dc9fd0b13c96 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653766 Jan 28 08:11:11.248595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 414/812] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:11:11.258445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1ec8d4c7-b35b-49b9-bd63-9c0826c363a3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:11.259506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1ec8d4c7-b35b-49b9-bd63-9c0826c363a3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:11.417530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1ec8d4c7-b35b-49b9-bd63-9c0826c363a3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:11.429234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1ec8d4c7-b35b-49b9-bd63-9c0826c363a3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1213 microversion: 2.1 time: 0.171547 Jan 28 08:11:11.429234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 399/813] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:11 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:12.443570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:12.444130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:12.451174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:12.452081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:12.452447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:12.452884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:12.511129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:12.518375 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-955336c2-0172-4462-8899-6429fe06bc61 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1217 microversion: 2.1 time: 0.078717 Jan 28 08:11:12.518956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 415/814] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:12 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:13.535354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:13.535968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:13.542536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:13.542982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:13.547983 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:13.547983 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:13.611451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:13.618653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-80c016fa-f44a-4ad7-9645-3872c2cbc333 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1217 microversion: 2.1 time: 0.086887 Jan 28 08:11:13.619278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 400/815] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:13 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:14.635914 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:14.636505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:14.642768 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:14.643226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:14.644047 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:14.644482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:14.702845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:14.710144 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cbf5f9ed-cd01-4f95-b92f-b5a2afe7f84e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1217 microversion: 2.1 time: 0.078459 Jan 28 08:11:14.710709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 416/816] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:14 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:15.727221 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:15.727863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:15.734702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:15.735160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:15.735974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:15.736415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:15.795210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:15.802524 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6581faee-4001-4f0c-ad4b-1f47992a8a8c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1265 microversion: 2.1 time: 0.078969 Jan 28 08:11:15.803304 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 401/817] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:15 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:16.823650 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:16.824407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:16.831208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:16.831693 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:16.832478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:16.832923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:16.974065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:16.982441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-07f2eb01-1f1e-4545-ba2c-fc2693c665f9 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.162406 Jan 28 08:11:16.992051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 417/818] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:16 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:17.935351 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-1c28f05e-8504-4aad-921f-286172abe89b req-a86942d0-24ee-4e74-8672-98667eb3dc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b85376-cb43-4af6-aa48-9d5c3897d16d", "tag": "3a441e19-6983-4010-b264-08e77af0695a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:17.936890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:11:17.936890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:11:17.944310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-1c28f05e-8504-4aad-921f-286172abe89b req-a86942d0-24ee-4e74-8672-98667eb3dc24 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:17.944779 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-1c28f05e-8504-4aad-921f-286172abe89b req-a86942d0-24ee-4e74-8672-98667eb3dc24 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:17.961493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-1c28f05e-8504-4aad-921f-286172abe89b req-a86942d0-24ee-4e74-8672-98667eb3dc24 service nova] Creating event network-changed:3a441e19-6983-4010-b264-08e77af0695a for instance c6b85376-cb43-4af6-aa48-9d5c3897d16d on hv-cinder-80403 Jan 28 08:11:17.974991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-1c28f05e-8504-4aad-921f-286172abe89b req-a86942d0-24ee-4e74-8672-98667eb3dc24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043716 Jan 28 08:11:17.980576 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 402/819] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:11:17.998939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:17.999759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:18.009457 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:18.010124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:18.011121 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:18.011579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:18.153579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:18.171647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-01bcfe4f-b839-4252-aef7-db5062444b64 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.176558 Jan 28 08:11:18.181403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 418/820] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:17 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:19.191807 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:19.191807 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:19.197764 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:19.198292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:19.199449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:19.199913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:19.342022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:19.349274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4d573ece-5bcd-413d-adee-f42de3b8ec6c tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.163609 Jan 28 08:11:19.349841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 403/821] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:19 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:20.202839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:20.203419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:20.209696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:20.212660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:20.212660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:20.212660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:20.291619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lazy-loading 'services' on Instance uuid b9052190-80be-4c55-92b8-d13dcaa2a40e {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:11:20.367071 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:20.370648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:20.374746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:20.375199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:20.376176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:20.376609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:20.550471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e7016465-48a4-4989-bbab-bc8893ec3ac3 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e/os-volume_attachments/2cf4d7de-9eb8-440a-a3bf-d3cf5b44fae6" status: 202 len: 0 microversion: 2.1 time: 0.351063 Jan 28 08:11:20.551323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 419/822] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:11:20 2022] DELETE /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e/os-volume_attachments/2cf4d7de-9eb8-440a-a3bf-d3cf5b44fae6 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:11:20.595864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:20.605695 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-32eb4051-4b25-4172-b2bc-1ecdb74551d3 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.242791 Jan 28 08:11:20.618898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 404/823] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:20 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:21.631314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:21.632152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:21.638872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:21.639423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:21.640424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:21.641015 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:21.786158 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:21.793970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8614dd83-588b-46f4-bbe0-337780764ba0 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.167867 Jan 28 08:11:21.794567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 420/824] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:21 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:22.727736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:22.728218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:22.734484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:22.734999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:22.735886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:22.736331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:22.764117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:11:22.809651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:22.810271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:22.816583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:22.819809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:22.819809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:22.819809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:22.953164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:22.960500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b9f52241-b248-4a6f-b786-6447ff2b9d42 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.154578 Jan 28 08:11:22.961077 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 421/825] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:22 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:11:23.057595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8f0d8b33-089b-40a7-a24b-2ec8f703f25f tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 204 len: 0 microversion: 2.1 time: 0.333226 Jan 28 08:11:23.058188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 405/826] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:11:22 2022] DELETE /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:11:23.066402 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:23.067092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:23.073782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:23.074274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:23.075648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:23.076084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:23.203982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:23.211710 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-209ddad6-b69a-44ab-a0d7-466ef2cbe979 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1511 microversion: 2.1 time: 0.148787 Jan 28 08:11:23.212281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 422/827] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:23 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:23.976485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:23.977187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:23.986494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:23.986947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:23.987945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:23.988206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:24.119832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:24.127111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-52609683-d46d-4daf-91f7-455f86394805 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.154623 Jan 28 08:11:24.127723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 406/828] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:23 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:24.234640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:24.240616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:24.242912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:24.243403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:24.244467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:24.244895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:24.375771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:24.383039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a56e9c50-235b-4dd4-984f-ab95bcd16126 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1511 microversion: 2.1 time: 0.155418 Jan 28 08:11:24.383719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 423/829] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:24 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:24.790436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-7eb29674-c9b8-4289-b985-971cee6b2f7f req-38021792-921d-477d-9036-0c92046adbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b85376-cb43-4af6-aa48-9d5c3897d16d", "name": "network-vif-plugged", "status": "completed", "tag": "3a441e19-6983-4010-b264-08e77af0695a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:24.792041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:11:24.792041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:11:24.799487 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7eb29674-c9b8-4289-b985-971cee6b2f7f req-38021792-921d-477d-9036-0c92046adbd6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:24.799927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7eb29674-c9b8-4289-b985-971cee6b2f7f req-38021792-921d-477d-9036-0c92046adbd6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:24.810153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-7eb29674-c9b8-4289-b985-971cee6b2f7f req-38021792-921d-477d-9036-0c92046adbd6 service nova] Creating event network-vif-plugged:3a441e19-6983-4010-b264-08e77af0695a for instance c6b85376-cb43-4af6-aa48-9d5c3897d16d on hv-cinder-80403 Jan 28 08:11:24.814822 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-7eb29674-c9b8-4289-b985-971cee6b2f7f req-38021792-921d-477d-9036-0c92046adbd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028260 Jan 28 08:11:24.815492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 407/830] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:11:25.143897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:25.144449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:25.150303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:25.150754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:25.151573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:25.152605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:25.281918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:25.289472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d77a58a0-ba30-4145-a57c-a6667da44a1d tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.149682 Jan 28 08:11:25.290040 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 424/831] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:25 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:25.400377 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:25.401002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:25.407374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:25.407824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:25.408622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:25.409144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:25.533314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:25.541129 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-87102f9e-2826-4860-b8c8-9a07d587aed8 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1511 microversion: 2.1 time: 0.145389 Jan 28 08:11:25.541697 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 408/832] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:25 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:26.305872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:26.306405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:26.313114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:26.313566 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:26.314351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:26.314785 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:26.443723 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:26.451537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6ffd2bb8-2763-4c37-a9d5-4554b759aa2e tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1313 microversion: 2.1 time: 0.149386 Jan 28 08:11:26.452111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 425/833] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:26 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:26.557412 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:26.558019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:26.564758 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:26.565238 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:26.566054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:26.566514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:26.723543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:26.730813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-34715d44-8ac2-4dc2-a92b-6610d2566b9c tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1511 microversion: 2.1 time: 0.177095 Jan 28 08:11:26.731401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 409/834] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:26 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:26.825119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-6230a602-b247-49f5-9f45-015ad301eb49 req-2bbd8429-9b51-4b4f-a6f3-01f111ec2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9052190-80be-4c55-92b8-d13dcaa2a40e", "name": "network-vif-deleted", "tag": "57cb1810-885e-4e06-9669-067bd53f4040"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:26.826729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:11:26.826729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:11:26.833647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-6230a602-b247-49f5-9f45-015ad301eb49 req-2bbd8429-9b51-4b4f-a6f3-01f111ec2cc3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:26.834092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-6230a602-b247-49f5-9f45-015ad301eb49 req-2bbd8429-9b51-4b4f-a6f3-01f111ec2cc3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:26.844516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-6230a602-b247-49f5-9f45-015ad301eb49 req-2bbd8429-9b51-4b4f-a6f3-01f111ec2cc3 service nova] Creating event network-vif-deleted:57cb1810-885e-4e06-9669-067bd53f4040 for instance b9052190-80be-4c55-92b8-d13dcaa2a40e on hv-cinder-80403 Jan 28 08:11:26.849320 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-6230a602-b247-49f5-9f45-015ad301eb49 req-2bbd8429-9b51-4b4f-a6f3-01f111ec2cc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028741 Jan 28 08:11:26.849909 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 426/835] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:11:27.468436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:27.469007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:27.474845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.475336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.476123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.476564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.607437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:27.614687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ac5c9b0b-a987-45e2-afa3-c21e7b0a4eeb tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1463 microversion: 2.1 time: 0.150621 Jan 28 08:11:27.615565 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 410/836] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:27 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:27.655874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:27.656521 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:27.662474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.663281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.664055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.664488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.691008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:11:27.751081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:27.751081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:27.754716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.755163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.755959 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.756469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.787492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:27.787947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:27.788652 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lazy-loading 'fault' on Instance uuid b9052190-80be-4c55-92b8-d13dcaa2a40e {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:11:27.842804 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1922f9b5df450b88e0183cb6dc1419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4caadfc3fd847008ba57fe5fc8d82a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:27.849764 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7d034cd5-5ee9-427c-a546-22d9ac4ee559 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 200 len: 1308 microversion: 2.1 time: 0.105826 Jan 28 08:11:27.855400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 411/837] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:27 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:11:27.996338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-53845bae-0cf7-4f2d-aa0b-5beb3863a44f tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 204 len: 0 microversion: 2.1 time: 0.345071 Jan 28 08:11:27.996875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 427/838] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:11:27 2022] DELETE /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:11:28.004734 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:28.005348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:28.011070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:28.012107 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:28.012879 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:28.013314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:28.140941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:28.148140 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6fa4f31f-6d30-4735-a8c8-6579b1d8f5dc tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1469 microversion: 2.1 time: 0.147048 Jan 28 08:11:28.148743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 412/839] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:27 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:28.866990 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:28.867786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] [instance: b9052190-80be-4c55-92b8-d13dcaa2a40e] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:28.874608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:28.875009 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:28.875820 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:28.876260 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:28.889244 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] HTTP exception thrown: Instance b9052190-80be-4c55-92b8-d13dcaa2a40e could not be found. Jan 28 08:11:28.889826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] Returning 404 to user: Instance b9052190-80be-4c55-92b8-d13dcaa2a40e could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:11:28.890626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a401356b-f650-4635-8d52-ea077b617246 tempest-VolumesSnapshotTestJSON-1882195298 tempest-VolumesSnapshotTestJSON-1882195298-project] 10.222.0.42 "GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e" status: 404 len: 111 microversion: 2.1 time: 0.027698 Jan 28 08:11:28.891153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 428/840] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:28 2022] GET /compute/v2.1/servers/b9052190-80be-4c55-92b8-d13dcaa2a40e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:11:29.166051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:29.166598 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:29.173547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:29.178596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:29.178596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:29.178596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:29.307113 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:29.314550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f5d25c2b-18cd-4787-b9d7-a8f40bdfab71 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1469 microversion: 2.1 time: 0.152400 Jan 28 08:11:29.319530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 413/841] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:29 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:30.333178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:30.333873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:30.345727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:30.346210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:30.347195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:30.347725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:30.392533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-7927f1ca-1351-4c20-88fc-9d86234bc0a9 req-8bd9ce84-7839-47d6-b863-b62745c185f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b85376-cb43-4af6-aa48-9d5c3897d16d", "name": "network-vif-deleted", "tag": "3a441e19-6983-4010-b264-08e77af0695a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:30.394088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:11:30.394088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:11:30.412873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7927f1ca-1351-4c20-88fc-9d86234bc0a9 req-8bd9ce84-7839-47d6-b863-b62745c185f7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:30.415611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7927f1ca-1351-4c20-88fc-9d86234bc0a9 req-8bd9ce84-7839-47d6-b863-b62745c185f7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:30.430696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-7927f1ca-1351-4c20-88fc-9d86234bc0a9 req-8bd9ce84-7839-47d6-b863-b62745c185f7 service nova] Creating event network-vif-deleted:3a441e19-6983-4010-b264-08e77af0695a for instance c6b85376-cb43-4af6-aa48-9d5c3897d16d on hv-cinder-80403 Jan 28 08:11:30.436158 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:30.437208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-7927f1ca-1351-4c20-88fc-9d86234bc0a9 req-8bd9ce84-7839-47d6-b863-b62745c185f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048026 Jan 28 08:11:30.438025 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 414/842] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:11:30.444842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0a639c7a-239c-4836-83c0-3ed150b6cd20 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1427 microversion: 2.1 time: 0.115829 Jan 28 08:11:30.444842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 429/843] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:30 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:31.462373 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:31.463075 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:31.469221 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:31.469674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:31.470449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:31.470919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:31.502269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:31.502717 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:31.503196 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lazy-loading 'fault' on Instance uuid c6b85376-cb43-4af6-aa48-9d5c3897d16d {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:11:31.549170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da32e6324514064853a8b6cfd8f5ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696d6da9391d4c4ebd7ffdbffa4dff42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:31.557633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-06b64790-1692-4c56-896f-9ea106dc6411 tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 200 len: 1303 microversion: 2.1 time: 0.099769 Jan 28 08:11:31.559096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 415/844] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:31 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:32.575271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:32.575906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] [instance: c6b85376-cb43-4af6-aa48-9d5c3897d16d] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:32.582128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:32.582587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:32.583389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:32.583824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:32.597271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] HTTP exception thrown: Instance c6b85376-cb43-4af6-aa48-9d5c3897d16d could not be found. Jan 28 08:11:32.597912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] Returning 404 to user: Instance c6b85376-cb43-4af6-aa48-9d5c3897d16d could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:11:32.598717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-20bf7c98-32a7-4314-88ad-3c5bd081b7ee tempest-VolumesNegativeTest-1502123925 tempest-VolumesNegativeTest-1502123925-project] 10.222.0.42 "GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d" status: 404 len: 111 microversion: 2.1 time: 0.027711 Jan 28 08:11:32.599274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 430/845] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:32 2022] GET /compute/v2.1/servers/c6b85376-cb43-4af6-aa48-9d5c3897d16d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:11:37.064175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:37.064675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:37.070906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:37.071456 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:37.072236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:37.072674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:37.164474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lazy-loading 'services' on Instance uuid 7ab426f8-a759-4d28-b87b-c5a029df5761 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:11:37.506348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5e80555f-89fc-4840-a35e-8f8f1b6e3d7d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments/fb0f1aff-5090-40f5-b4b4-01e82cee589c" status: 202 len: 0 microversion: 2.1 time: 0.642947 Jan 28 08:11:37.507449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 416/846] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:11:36 2022] DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments/fb0f1aff-5090-40f5-b4b4-01e82cee589c => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:11:38.626592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2d32c3a3-0241-4c65-938d-2ecc2dbb043a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:38.633024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d32c3a3-0241-4c65-938d-2ecc2dbb043a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:38.633478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2d32c3a3-0241-4c65-938d-2ecc2dbb043a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:38.656284 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2d32c3a3-0241-4c65-938d-2ecc2dbb043a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Going to try to stop instance {{(pid=116947) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 08:11:38.879638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2d32c3a3-0241-4c65-938d-2ecc2dbb043a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 202 len: 0 microversion: 2.1 time: 0.257035 Jan 28 08:11:38.880478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 431/847] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:11:38 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:11:38.890003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:38.890478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:38.898443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:38.898725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:38.899938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:38.900376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:39.059759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:39.070985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-535c0afd-aec5-4f4f-a369-3200e64b551e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.185673 Jan 28 08:11:39.071919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 417/848] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:38 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:11:40.089420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:40.090130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:40.096656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:40.097112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:40.097889 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:40.098328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:40.223960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:40.231363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d3eb4cc2-5bb9-48de-8e94-ef6ea23f38e7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.146450 Jan 28 08:11:40.231934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 432/849] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:40 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:41.247969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:41.248590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:41.254872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:41.255360 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:41.256145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:41.256705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:41.387222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:41.395089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-59bb782d-e81b-40f3-b60c-839a643cb7b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.150881 Jan 28 08:11:41.395693 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 418/850] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:41 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:42.412044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:42.412921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:42.419146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:42.420562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:42.420562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:42.420831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:42.547691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:42.554906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f8b65e6e-e33e-4c23-91b9-47c32f7613dd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.146623 Jan 28 08:11:42.555498 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 433/851] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:42 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:43.572406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:43.573037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:43.579185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:43.579665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:43.580432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:43.580866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:43.709284 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:43.716550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fac85faf-b1be-4279-923c-cd41199062c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.147734 Jan 28 08:11:43.717114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 419/852] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:43 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:44.733504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:44.734808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:44.741154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:44.741614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:44.742423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:44.742865 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:44.868923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:44.876137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b9ad1835-590b-4456-8423-f2194c27a1ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.146493 Jan 28 08:11:44.876700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 434/853] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:44 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:45.892810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:45.893356 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:45.899587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:45.900040 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:45.903759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:45.903759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:46.041800 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:46.049653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a31578a1-e349-48fc-aa50-e8e08e30fa42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.160722 Jan 28 08:11:46.050211 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 420/854] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:45 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:47.066805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:47.067480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:47.073684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:47.074143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:47.074920 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:47.075397 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:47.200845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:47.208139 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6d2604dc-f446-4319-b0c2-6d7bc42a7ffb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.145029 Jan 28 08:11:47.208695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 435/855] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:47 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:48.225076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:48.226336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:48.232529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:48.233424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:48.234712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:48.235260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:48.365750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:48.373249 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d37917ee-470a-4b5c-b437-4403f7c982f8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.152028 Jan 28 08:11:48.373824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 421/856] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:48 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:49.389548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:49.390151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:49.396385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:49.396830 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:49.397591 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:49.398022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:49.531970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:49.539649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a9345cb3-8935-4e91-8197-e69182a98b18 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1677 microversion: 2.1 time: 0.153615 Jan 28 08:11:49.540417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 436/857] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:49 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:50.556130 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:50.556746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:50.563299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:50.563758 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:50.564536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:50.564970 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:50.700346 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:50.708398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3bc9f1bd-5f79-4f6f-96ac-85ca83290380 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1654 microversion: 2.1 time: 0.156011 Jan 28 08:11:50.708996 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 422/858] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:50 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:50.724446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3441c4e6-aaf7-42be-bd66-d89cf4237c6d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:11:50.730738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3441c4e6-aaf7-42be-bd66-d89cf4237c6d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:50.731184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3441c4e6-aaf7-42be-bd66-d89cf4237c6d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:50.756050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3441c4e6-aaf7-42be-bd66-d89cf4237c6d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Going to try to start instance {{(pid=116947) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 08:11:50.975946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3441c4e6-aaf7-42be-bd66-d89cf4237c6d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action" status: 202 len: 0 microversion: 2.1 time: 0.254889 Jan 28 08:11:50.976969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 437/859] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:11:50 2022] POST /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:11:50.985847 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:50.986459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:50.992557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:50.993203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:50.993990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:50.994429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:51.127675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:51.135144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-836f0a27-5b18-4a18-9224-6d1c971fa6b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1663 microversion: 2.1 time: 0.153029 Jan 28 08:11:51.135753 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 423/860] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:50 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:11:52.152789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:52.153430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:52.160608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:52.161058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:52.161839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:52.162272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:52.289323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:52.296705 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4df7f99c-3bb4-4a42-94d7-67dd7e4be47f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1663 microversion: 2.1 time: 0.148079 Jan 28 08:11:52.297353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 438/861] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:52 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:11:53.313968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:11:53.314836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:11:53.321297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:53.321744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:53.322515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:11:53.322947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:11:53.456447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:11:53.462683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ada26134-3011-438d-8d58-f4bb96df036d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1667 microversion: 2.1 time: 0.152437 Jan 28 08:11:53.463365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 424/862] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:11:53 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:06.276722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:06.284538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:06.284538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.284538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.284538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.284892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.313024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e08d7003-e203-41e2-94a7-d1381cd861d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments/9109dbe8-3c31-4bd1-b366-f2126265ad28" status: 200 len: 194 microversion: 2.20 time: 0.197035 Jan 28 08:12:06.313588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 439/863] 10.222.0.42 () {60 vars in 1453 bytes} [Fri Jan 28 08:12:06 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments/9109dbe8-3c31-4bd1-b366-f2126265ad28 => generated 194 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:12:06.374982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:06.375488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:06.382022 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.382475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.383270 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.383838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.468324 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lazy-loading 'services' on Instance uuid eff2ba16-416f-418a-8b21-56d5ae8a2e32 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:12:06.668379 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c891b3b7-6c11-4981-9a59-308d886bcf19 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments/9109dbe8-3c31-4bd1-b366-f2126265ad28" status: 202 len: 0 microversion: 2.20 time: 0.297622 Jan 28 08:12:06.669236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 425/864] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jan 28 08:12:06 2022] DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments/9109dbe8-3c31-4bd1-b366-f2126265ad28 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:12:06.678175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:06.679163 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:06.685156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.685697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.686485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:06.686922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:06.715339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-244d6143-eeef-4345-9eea-0d52aa33b5f7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041647 Jan 28 08:12:06.715892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 440/865] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jan 28 08:12:06 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:12:07.726612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:07.727702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:07.734173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:07.736833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:07.736833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:07.736833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:07.764963 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6b00cb87-c122-4453-8557-beed26839f07 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042620 Jan 28 08:12:07.765564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 426/866] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jan 28 08:12:07 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:07.821680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:07.823798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:07.833631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:07.834082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:07.834871 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:07.835581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:07.860360 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:12:08.104584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d43a0da2-9a35-4708-94c5-bfeffe39facd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 204 len: 0 microversion: 2.20 time: 0.286486 Jan 28 08:12:08.105590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 441/867] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jan 28 08:12:07 2022] DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 08:12:08.117140 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:08.117785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:08.124628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:08.125080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:08.125868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:08.126306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:08.254426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:08.262343 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:08.263915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:08.265064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3e5612e4-ddf2-4b41-96e0-cdcf9272f65b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.155309 Jan 28 08:12:08.265631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 427/868] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:08 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:09.286315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:09.287287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:09.293232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:09.293692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:09.294468 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:09.294910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:09.426683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:09.434371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:09.435922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:09.437061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-35dbc58e-5b2f-4125-a41e-bcccbe9026b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.155601 Jan 28 08:12:09.437622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 442/869] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:09 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:10.456347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:10.456993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:10.464502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:10.468806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:10.468806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:10.468806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:10.696698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:10.704560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:10.706572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:10.707783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3624ddec-2737-4305-878f-3bc2c9ad8018 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1722 microversion: 2.20 time: 0.255780 Jan 28 08:12:10.708342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 428/870] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:10 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:11.177609 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-6858d207-e6d0-4a96-af17-07b09493d836 req-98aab215-0139-4150-a45d-2633230dfe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2ba16-416f-418a-8b21-56d5ae8a2e32", "name": "network-vif-deleted", "tag": "19cf30ba-e4bd-4984-a3cd-63b09ed4149b"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:11.179569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:11.179569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:12:11.186884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-6858d207-e6d0-4a96-af17-07b09493d836 req-98aab215-0139-4150-a45d-2633230dfe1a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:11.187507 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-6858d207-e6d0-4a96-af17-07b09493d836 req-98aab215-0139-4150-a45d-2633230dfe1a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:11.199668 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-6858d207-e6d0-4a96-af17-07b09493d836 req-98aab215-0139-4150-a45d-2633230dfe1a service nova] Creating event network-vif-deleted:19cf30ba-e4bd-4984-a3cd-63b09ed4149b for instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 on hv-cinder-80403 Jan 28 08:12:11.205202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-6858d207-e6d0-4a96-af17-07b09493d836 req-98aab215-0139-4150-a45d-2633230dfe1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093955 Jan 28 08:12:11.206343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 443/871] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:12:11.725897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:11.726863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:11.734352 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:11.734910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:11.735832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:11.736519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:11.768866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:11.769608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:11.770278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lazy-loading 'fault' on Instance uuid eff2ba16-416f-418a-8b21-56d5ae8a2e32 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:12:11.810975 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:11.820411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:11.822328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:11.823620 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-51509a75-00c0-4343-8d7b-e00122778e7b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 200 len: 1371 microversion: 2.20 time: 0.101480 Jan 28 08:12:11.824192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 429/872] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:11 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:12.843451 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:12.844482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:12.850424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:12.850877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:12.851713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:12.852179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:12.866718 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. Jan 28 08:12:12.872153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:12:12.872153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f082509c-9eaa-450e-9ef3-8c8cbcd3cd06 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 404 len: 111 microversion: 2.20 time: 0.029355 Jan 28 08:12:12.872153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 444/873] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:12 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 08:12:12.877929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8bee6167-b4e1-4625-91f6-932650b79fa6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '.version_select at 0x7f347404b0d0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:12.979418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8bee6167-b4e1-4625-91f6-932650b79fa6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921541166" status: 204 len: 0 microversion: 2.20 time: 0.105404 Jan 28 08:12:12.980098 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 430/874] 10.222.0.42 () {60 vars in 1258 bytes} [Fri Jan 28 08:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921541166 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 08:12:13.858627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: .version_select at 0x7f346ff3cf70>, body: {"keypair": {"name": "tempest-keypair-1586294556"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:13.878083 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:12:13.881778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:12:14.171574 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:12:14.175352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:12:14.188532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fddaf2b2-f3ef-42cd-9abb-2772d5862e24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.333643 Jan 28 08:12:14.189612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 445/875] 10.222.0.42 () {62 vars in 1198 bytes} [Fri Jan 28 08:12:13 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 335 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 08:12:16.716980 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-436824580", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f1cf5d-60d2-41bd-aebf-58b952073da1"}], "security_groups": [{"name": "tempest-securitygroup--228524075"}], "key_name": "tempest-keypair-1586294556", "user_data": "}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:17.068193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] validate_networks() for [('71f1cf5d-60d2-41bd-aebf-58b952073da1', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:12:17.526129 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:12:17.526589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:12:17.527094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:12:17.527582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:12:17.527997 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:12:17.537342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:17.537788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:17.538593 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:17.539027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:17.554927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for project 45b89e609e844303aa304ec72a985cee. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:12:17.558855 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Getting quotas for user 38d8ece1530446b9b26d79403beef557 and project 45b89e609e844303aa304ec72a985cee. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:12:17.569420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:12:17.571797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:12:17.681719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0f523c60-3b35-4c4f-9546-609c7f90cd73 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.969248 Jan 28 08:12:17.682375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 431/876] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jan 28 08:12:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 08:12:17.693366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:17.694003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:17.750188 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:17.761589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:17.761589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:17.762385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9f09361b-aac8-4394-ab22-75ea29c74953 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1281 microversion: 2.20 time: 0.073986 Jan 28 08:12:17.762930 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 446/877] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:17 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:18.781052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:18.781667 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:18.788701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:18.789337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:18.790161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:18.790605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:18.851854 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:18.863958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:18.863958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:18.863958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-876ce32b-5136-4feb-b558-a36ac4bb61b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1285 microversion: 2.20 time: 0.087178 Jan 28 08:12:18.864560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 432/878] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:18 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:19.881184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:19.881807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:19.888157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:19.888553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:19.889332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:19.889776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:19.957543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:19.965316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:19.966825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:19.967940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f33f77c7-0f75-4888-885a-0a9e30337cd5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1333 microversion: 2.20 time: 0.090524 Jan 28 08:12:19.968497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 447/879] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:19 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:20.989227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:20.989840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:20.996079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:20.996527 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:20.997293 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:20.997723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:21.055980 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:21.063817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:21.065989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:21.067187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-42e9273e-33c3-492f-8235-28603d94a514 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1339 microversion: 2.20 time: 0.081720 Jan 28 08:12:21.067782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 433/880] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:20 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:22.085381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:22.086638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:22.093672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:22.094245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:22.095181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:22.096369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:22.241955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:22.250332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:22.251970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:22.253152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e2e0bb98-7ec2-4415-a133-8e78e86138c4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.171633 Jan 28 08:12:22.253717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 448/881] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:22 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:12:22.418398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-e367b440-19e8-457f-8528-a588d0b64a96 req-5b70927d-2807-4651-9422-4c5cffe9af30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:22.420895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:22.420895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:22.429878 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-e367b440-19e8-457f-8528-a588d0b64a96 req-5b70927d-2807-4651-9422-4c5cffe9af30 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:22.431275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-e367b440-19e8-457f-8528-a588d0b64a96 req-5b70927d-2807-4651-9422-4c5cffe9af30 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:22.442659 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-e367b440-19e8-457f-8528-a588d0b64a96 req-5b70927d-2807-4651-9422-4c5cffe9af30 service nova] Creating event network-changed:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:12:22.454010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-e367b440-19e8-457f-8528-a588d0b64a96 req-5b70927d-2807-4651-9422-4c5cffe9af30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039118 Jan 28 08:12:22.454650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 434/882] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:23.271875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:23.272734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:23.284412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:23.284412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:23.284412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:23.284412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:23.426404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:23.427392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2129239865", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "17745b36-c0a5-4245-afc8-dbdfa356bde0"}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:23.434363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:23.435948 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:23.437043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2b2feae5-0f78-4936-ae52-0da63ea306b4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.169580 Jan 28 08:12:23.437772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 449/883] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:23 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:23.480627 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] validate_networks() for [('17745b36-c0a5-4245-afc8-dbdfa356bde0', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:12:23.809025 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:12:23.809447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:12:23.809914 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:12:23.810318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:12:23.810724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:12:23.819108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:23.819582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:23.820385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:23.820815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:23.836616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Getting quotas for project 2e3a69d1c34944be9eedff8a329f3066. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:12:23.840759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Getting quotas for user 18adb6535e964ad098000131b6baa36c and project 2e3a69d1c34944be9eedff8a329f3066. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:12:23.851781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:12:23.854080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:12:24.018993 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-746522a9-4ce4-425b-9a3e-d8af5969e4fe tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596595 Jan 28 08:12:24.019595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 435/884] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:12:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 08:12:24.029178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0d216b57-37aa-4ec7-86af-e497aeb85fb1 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:24.029804 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0d216b57-37aa-4ec7-86af-e497aeb85fb1 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:24.084154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0d216b57-37aa-4ec7-86af-e497aeb85fb1 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:24.090543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0d216b57-37aa-4ec7-86af-e497aeb85fb1 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1214 microversion: 2.1 time: 0.064992 Jan 28 08:12:24.091114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 450/885] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:24 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:24.455850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:24.456469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:24.463062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:24.463663 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:24.464476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:24.465253 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:24.597538 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:24.605375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:24.606886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:24.608017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a469ccda-71eb-4b61-a43f-6ca6cdb7a2c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.157212 Jan 28 08:12:24.608568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 436/886] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:24 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:25.107691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:25.108302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:25.114945 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:25.115434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:25.116200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:25.116644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:25.175334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:25.182702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f562be4b-a7cb-49e3-ab49-da6c1492e8be tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1218 microversion: 2.1 time: 0.078632 Jan 28 08:12:25.183309 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 451/887] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:25 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:25.625828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:25.626438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:25.632786 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:25.633241 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:25.634020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:25.634458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:25.768281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:25.775998 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:25.777491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:25.778571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a2f08e23-543a-4c44-b92b-fe3913b1e95b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.156568 Jan 28 08:12:25.779125 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 437/888] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:25 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:26.200205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:26.200817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:26.207722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:26.208178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:26.208959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:26.209389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:26.266694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:26.275056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fe3ce9fa-f302-48e3-b9e4-a88f9a7d31b7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1274 microversion: 2.1 time: 0.078235 Jan 28 08:12:26.276507 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 452/889] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:26 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1274 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:26.797448 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:26.798185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:26.805301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:26.805821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:26.806616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:26.807057 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:26.986480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:26.994816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:26.996704 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:26.997849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-76120cae-a18d-47a6-a21f-cb72caccf2d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.204429 Jan 28 08:12:26.998412 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 438/890] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:26 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:27.291609 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:27.292227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:27.298459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:27.298905 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:27.299706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:27.300140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:27.432504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:27.440627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ab9794a4-2a40-43e9-8ac1-486503b04743 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.152602 Jan 28 08:12:27.441327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 453/891] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:27 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:27.665738 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-b3a1ada3-cd75-4b47-8393-dded15851117 req-6dc98ef5-7c42-4bc6-8725-bbd0e4a87f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2226a290-85fe-457f-abbf-0b254bb914db", "tag": "5a663dc2-1f42-44de-bf3c-0a9208fdbfc3"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:27.667369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:27.667369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:27.674120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-b3a1ada3-cd75-4b47-8393-dded15851117 req-6dc98ef5-7c42-4bc6-8725-bbd0e4a87f19 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:27.675097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-b3a1ada3-cd75-4b47-8393-dded15851117 req-6dc98ef5-7c42-4bc6-8725-bbd0e4a87f19 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:27.685128 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-b3a1ada3-cd75-4b47-8393-dded15851117 req-6dc98ef5-7c42-4bc6-8725-bbd0e4a87f19 service nova] Creating event network-changed:5a663dc2-1f42-44de-bf3c-0a9208fdbfc3 for instance 2226a290-85fe-457f-abbf-0b254bb914db on hv-cinder-80403 Jan 28 08:12:27.690229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-b3a1ada3-cd75-4b47-8393-dded15851117 req-6dc98ef5-7c42-4bc6-8725-bbd0e4a87f19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028422 Jan 28 08:12:27.690821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 439/892] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:28.015595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:28.016216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:28.022028 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:28.022479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:28.023267 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:28.023721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:28.151606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:28.159340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:28.160853 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:28.162204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0e1803f6-f152-48eb-8b40-7292c666413a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.150305 Jan 28 08:12:28.162762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 454/893] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:28 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:28.458007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:28.458644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:28.464776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:28.465229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:28.466037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:28.466474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:28.598218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:28.605525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-96731e6d-1c2a-4952-9240-968f84f36b9f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.152163 Jan 28 08:12:28.606089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 440/894] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:28 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:29.180069 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:29.180755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:29.187523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:29.188035 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:29.189371 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:29.189820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:29.219505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-8771c3b0-5222-4fdc-aa75-42eb1e123ff5 req-0eb64790-5b39-4f03-87f0-243da4e080f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "name": "network-vif-plugged", "status": "completed", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:29.221870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:29.221870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:12:29.229450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-8771c3b0-5222-4fdc-aa75-42eb1e123ff5 req-0eb64790-5b39-4f03-87f0-243da4e080f6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:29.229991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-8771c3b0-5222-4fdc-aa75-42eb1e123ff5 req-0eb64790-5b39-4f03-87f0-243da4e080f6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:29.248358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-8771c3b0-5222-4fdc-aa75-42eb1e123ff5 req-0eb64790-5b39-4f03-87f0-243da4e080f6 service nova] Creating event network-vif-plugged:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:12:29.257065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-8771c3b0-5222-4fdc-aa75-42eb1e123ff5 req-0eb64790-5b39-4f03-87f0-243da4e080f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161596 Jan 28 08:12:29.257780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 455/895] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:29.355770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:29.365474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:29.368599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:29.368599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c7a98c67-9b16-4d58-a84f-02c5656c095b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.192257 Jan 28 08:12:29.379844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 441/896] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:29 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:12:29.622080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:29.622835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:29.629755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:29.630211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:29.630996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:29.631484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:29.757476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:29.764676 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-718a9086-2bf9-4228-bfb2-475faff2ce3a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.146607 Jan 28 08:12:29.765264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 456/897] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:29 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:30.387062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:30.387707 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:30.396721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:30.397268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:30.398248 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:30.398767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:30.529918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:30.537863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:30.539385 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:30.540472 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-af4682a8-611d-46d7-a953-273af1a2eb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1406 microversion: 2.20 time: 0.157146 Jan 28 08:12:30.541033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 442/898] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:30 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:30.781055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:30.781595 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:30.788181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:30.788636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:30.789412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:30.789850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:30.917472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:30.925178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d51ca3f1-d811-458a-8bc9-545555c58131 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.147914 Jan 28 08:12:30.925753 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 457/899] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:30 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:31.557658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:31.558259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:31.564989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.565436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:31.566202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.566626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:31.691445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:31.699029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:31.700558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:31.701683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e89280bd-7a40-49f9-93fe-c48b74e319ae tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1597 microversion: 2.20 time: 0.147758 Jan 28 08:12:31.702245 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 443/900] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:12:31 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1597 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:31.718700 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:31.719196 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:31.724988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.725443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:31.726219 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.726656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:31.802496 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cd0c9a67-84da-4f30-84e4-10e6b29e5e8a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087389 Jan 28 08:12:31.803094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 458/901] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jan 28 08:12:31 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:12:31.942544 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:31.943095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:31.948925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.949378 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:31.950155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:31.950601 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:32.078019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:32.085977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c4adf595-9471-444a-bc7a-9591da2ed3f0 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.148022 Jan 28 08:12:32.086770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 444/902] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:31 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:33.104698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:33.104698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:33.112195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.112740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.113419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.113847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.142690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-6e0254c3-a758-45de-8575-cf1e2b92772b req-bb338844-3bb9-495c-8641-1cb9a175fe15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2226a290-85fe-457f-abbf-0b254bb914db", "name": "network-vif-plugged", "status": "completed", "tag": "5a663dc2-1f42-44de-bf3c-0a9208fdbfc3"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:33.144291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:33.144291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:33.151348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-6e0254c3-a758-45de-8575-cf1e2b92772b req-bb338844-3bb9-495c-8641-1cb9a175fe15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.155727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-6e0254c3-a758-45de-8575-cf1e2b92772b req-bb338844-3bb9-495c-8641-1cb9a175fe15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.169724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-6e0254c3-a758-45de-8575-cf1e2b92772b req-bb338844-3bb9-495c-8641-1cb9a175fe15 service nova] Creating event network-vif-plugged:5a663dc2-1f42-44de-bf3c-0a9208fdbfc3 for instance 2226a290-85fe-457f-abbf-0b254bb914db on hv-cinder-80403 Jan 28 08:12:33.175695 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-6e0254c3-a758-45de-8575-cf1e2b92772b req-bb338844-3bb9-495c-8641-1cb9a175fe15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036667 Jan 28 08:12:33.176297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 445/903] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:33.182181 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:33.195029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:33.202540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.203387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.204870 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.205484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.276479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:33.276660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-adb0938e-4970-482f-81e7-af6a9988ed04 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.095884 Jan 28 08:12:33.276660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 446/904] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:33 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:33.280098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9a0c076c-2f77-49a8-87b4-f3bac18340d7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.181467 Jan 28 08:12:33.280667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 459/905] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:33 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:33.350816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-d3e3e63e-743d-4975-81c4-8f4636e7ed6c req-ae002be3-94e6-4db3-9c6c-1cf1a683522c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:33.352395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:33.352395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:33.362946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-d3e3e63e-743d-4975-81c4-8f4636e7ed6c req-ae002be3-94e6-4db3-9c6c-1cf1a683522c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:33.363644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-d3e3e63e-743d-4975-81c4-8f4636e7ed6c req-ae002be3-94e6-4db3-9c6c-1cf1a683522c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:33.377177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-d3e3e63e-743d-4975-81c4-8f4636e7ed6c req-ae002be3-94e6-4db3-9c6c-1cf1a683522c service nova] Creating event network-changed:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:12:33.382935 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-d3e3e63e-743d-4975-81c4-8f4636e7ed6c req-ae002be3-94e6-4db3-9c6c-1cf1a683522c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104195 Jan 28 08:12:33.383767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 447/906] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:34.284979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:34.285819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:34.292577 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:34.293032 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:34.293806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:34.294246 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:34.298745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:34.299490 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:34.305477 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:34.305987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:34.306797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:34.307237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:34.403692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a0910241-59b9-4bfb-9474-5bf0a27545f9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.122750 Jan 28 08:12:34.404332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 460/907] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:34 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:34.443392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:34.450518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8f4637a0-0619-4677-b477-987423d10a9b tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1314 microversion: 2.1 time: 0.156934 Jan 28 08:12:34.451080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 448/908] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:34 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:35.414832 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:35.415815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:35.422659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:35.423641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:35.424435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:35.424855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:35.466594 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:35.467277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:35.473457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:35.473889 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:35.474647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:35.475078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:35.484538 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-49e05c52-6ed5-4bca-837d-4427c5254ce0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.073955 Jan 28 08:12:35.488278 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 461/909] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:35 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:35.599657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:35.606848 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-81ffefab-55cf-4505-879a-ded0f22dbb9c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1496 microversion: 2.1 time: 0.143871 Jan 28 08:12:35.607442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 449/910] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:35 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1496 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:36.352912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:36.353498 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:36.360332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.360787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.361568 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.362006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.386195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:12:36.496147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:36.497086 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:36.503904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.507700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.507700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.507700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.565389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-19f64267-4cc5-4e4a-ac6b-f1ee3f12aa10 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.072921 Jan 28 08:12:36.566044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 450/911] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:36 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:36.651391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7857b778-5603-4c3a-8d68-96ec4935e37c tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 204 len: 0 microversion: 2.1 time: 0.302168 Jan 28 08:12:36.651978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 462/912] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:12:36 2022] DELETE /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:12:36.660382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:36.661074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:36.668201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.668645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.669413 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:36.669844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:36.800159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:36.807828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aa612ea8-a861-4210-a4d1-86c403c80f9d tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1502 microversion: 2.1 time: 0.151413 Jan 28 08:12:36.808382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 451/913] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:36 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:37.575980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:37.576911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:37.584387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:37.584843 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:37.585620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:37.586063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:37.648986 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-84fc118b-2d48-4ef9-87ea-81e235028852 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.077094 Jan 28 08:12:37.649598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 463/914] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:37 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:37.825469 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:37.826250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:37.833144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:37.833591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:37.834357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:37.834841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:37.963009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:37.970272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-74220c1a-89bc-46ef-83db-5b5a6e67de6a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1502 microversion: 2.1 time: 0.148690 Jan 28 08:12:37.970839 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 452/915] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:37 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:38.666583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:38.669368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:38.677059 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:38.677520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:38.678315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:38.688720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:38.715938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-18505b7c-0ff9-4f42-84ea-8656b7b8be45 req-8e76e4ac-a961-4bb0-95e0-c95a85bbc1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2226a290-85fe-457f-abbf-0b254bb914db", "name": "network-vif-deleted", "tag": "5a663dc2-1f42-44de-bf3c-0a9208fdbfc3"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:38.717702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:38.717702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:38.728015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-18505b7c-0ff9-4f42-84ea-8656b7b8be45 req-8e76e4ac-a961-4bb0-95e0-c95a85bbc1e6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:38.728463 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-18505b7c-0ff9-4f42-84ea-8656b7b8be45 req-8e76e4ac-a961-4bb0-95e0-c95a85bbc1e6 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:38.741145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-18505b7c-0ff9-4f42-84ea-8656b7b8be45 req-8e76e4ac-a961-4bb0-95e0-c95a85bbc1e6 service nova] Creating event network-vif-deleted:5a663dc2-1f42-44de-bf3c-0a9208fdbfc3 for instance 2226a290-85fe-457f-abbf-0b254bb914db on hv-cinder-80403 Jan 28 08:12:38.745948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-18505b7c-0ff9-4f42-84ea-8656b7b8be45 req-8e76e4ac-a961-4bb0-95e0-c95a85bbc1e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034586 Jan 28 08:12:38.750761 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 453/916] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:38.757310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8bf76a07-f229-4480-a0b9-7f50b5c094f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.100628 Jan 28 08:12:38.758200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 464/917] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:38 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:38.987578 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:38.988273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:38.994950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:38.995436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:38.996209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:38.997132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:39.028827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:39.029271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:39.029724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lazy-loading 'fault' on Instance uuid 2226a290-85fe-457f-abbf-0b254bb914db {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:12:39.069064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:39.077207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4314339f-86b4-4c67-8c66-5698ae9d99b8 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 200 len: 1304 microversion: 2.1 time: 0.094410 Jan 28 08:12:39.077785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 454/918] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:38 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:39.768837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:39.769869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:39.776742 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:39.777196 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:39.777972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:39.778413 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:39.837973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a3ef65e7-5acf-4de6-986b-14751413d195 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.073625 Jan 28 08:12:39.838582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 465/919] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:39 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:40.094159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:40.094928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 2226a290-85fe-457f-abbf-0b254bb914db] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:40.101777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.102232 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.103009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.103478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.116468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] HTTP exception thrown: Instance 2226a290-85fe-457f-abbf-0b254bb914db could not be found. Jan 28 08:12:40.117058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Returning 404 to user: Instance 2226a290-85fe-457f-abbf-0b254bb914db could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:12:40.117866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-505c1692-9c91-4498-9003-9932077e7070 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db" status: 404 len: 111 microversion: 2.1 time: 0.027448 Jan 28 08:12:40.118399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 455/920] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:40 2022] GET /compute/v2.1/servers/2226a290-85fe-457f-abbf-0b254bb914db => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:12:40.165396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2071405500", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "networks": [{"uuid": "17745b36-c0a5-4245-afc8-dbdfa356bde0"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:40.215280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] validate_networks() for [('17745b36-c0a5-4245-afc8-dbdfa356bde0', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:12:40.604030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:12:40.604514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:12:40.604992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:12:40.605406 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:12:40.605847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:12:40.614957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.619417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.619417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.619417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.633831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Getting quotas for project 2e3a69d1c34944be9eedff8a329f3066. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:12:40.638109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Getting quotas for user 18adb6535e964ad098000131b6baa36c and project 2e3a69d1c34944be9eedff8a329f3066. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:12:40.648926 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:12:40.651314 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:12:40.807221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14ea8068-b676-4929-a8f1-83720ace7da9 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646026 Jan 28 08:12:40.807919 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 466/921] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:12:40.818560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-390444d0-81ac-4ed8-b9df-6f9fff1208ba tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:40.819167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-390444d0-81ac-4ed8-b9df-6f9fff1208ba tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:40.848659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:40.849681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:40.856172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.856613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.857386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:40.857816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:40.871362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-390444d0-81ac-4ed8-b9df-6f9fff1208ba tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:40.878751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-390444d0-81ac-4ed8-b9df-6f9fff1208ba tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1214 microversion: 2.1 time: 0.064449 Jan 28 08:12:40.879535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 456/922] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:40 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:40.938417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ca2aad2b-c098-446e-a693-34f996299cd4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.093349 Jan 28 08:12:40.939308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 467/923] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:40 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:41.895609 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:41.896874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:41.903399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:41.903859 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:41.904644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:41.905070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:41.950307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:41.951334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:41.958139 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:41.959161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:41.959968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:41.960400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:41.964569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:41.971842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-99a8f3a3-dba1-46e5-af9d-3dbf857023c3 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1266 microversion: 2.1 time: 0.080023 Jan 28 08:12:41.972411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 457/924] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:41 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:42.029935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-35efd84b-8855-4378-8f95-e3731e092dde tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.083574 Jan 28 08:12:42.030578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 468/925] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:41 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:12:42.989099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:42.989687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:42.996214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:42.996656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:42.997433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:42.998229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:43.042223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:43.043356 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:43.050631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:43.051206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:43.052105 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:43.052618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:43.099390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:43.106581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ea9c9ca9-27a2-4a93-bf31-f376b05863d5 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1272 microversion: 2.1 time: 0.121489 Jan 28 08:12:43.107153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 458/926] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:42 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:43.121844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-30c2ef2e-3bcf-43eb-9028-b394eae89571 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 14 microversion: 2.20 time: 0.083614 Jan 28 08:12:43.123703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 469/927] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:43 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:44.123525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:44.124254 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:44.131446 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:44.131968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:44.132953 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:44.133410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:44.140086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:44.141124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:44.148512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:44.148962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:44.149749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:44.150601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:44.225134 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0438b1bb-fcf9-4403-bd96-00e0271f7fc1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 2137 microversion: 2.20 time: 0.089113 Jan 28 08:12:44.227019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 470/928] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:44 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 2137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:12:44.281917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-ac32ef0d-05a5-4303-b8c4-48f3edd1909c req-3e04f2a9-cc89-4e3e-8fee-47eed798e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923499e3-9b07-4c4f-829b-ea148e6614a8", "tag": "2417e938-c871-4a23-9a9e-55f371cf4330"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:44.283183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:44.283183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:12:44.292358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ac32ef0d-05a5-4303-b8c4-48f3edd1909c req-3e04f2a9-cc89-4e3e-8fee-47eed798e0ba service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:44.292811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ac32ef0d-05a5-4303-b8c4-48f3edd1909c req-3e04f2a9-cc89-4e3e-8fee-47eed798e0ba service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:44.304669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-ac32ef0d-05a5-4303-b8c4-48f3edd1909c req-3e04f2a9-cc89-4e3e-8fee-47eed798e0ba service nova] Creating event network-changed:2417e938-c871-4a23-9a9e-55f371cf4330 for instance 923499e3-9b07-4c4f-829b-ea148e6614a8 on hv-cinder-80403 Jan 28 08:12:44.309506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-ac32ef0d-05a5-4303-b8c4-48f3edd1909c req-3e04f2a9-cc89-4e3e-8fee-47eed798e0ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031923 Jan 28 08:12:44.310410 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 471/929] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:12:44.335470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:44.342941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d0355fd4-6018-4118-aac7-d5127bd28b33 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.223223 Jan 28 08:12:44.346806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 459/930] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:44 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:45.236569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:45.237633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:45.244374 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:45.244831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:45.245616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:45.246056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:45.322141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dcb70d2f-be34-40fb-9584-452446d76e4b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 13887 microversion: 2.20 time: 0.090219 Jan 28 08:12:45.323044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 472/931] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:45 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 13887 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:45.359225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:45.359866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:45.366683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:45.367143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:45.367918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:45.368348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:45.495966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:45.503206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ad2ca2b8-be62-4f79-8092-853e2687f3dc tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.147569 Jan 28 08:12:45.503819 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 460/932] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:45 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:46.333430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:46.336697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:46.350479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:46.350934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:46.351864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:46.355508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:46.445501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-97bf371e-91fe-4ded-bbae-893aa7769165 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 18356 microversion: 2.20 time: 0.115979 Jan 28 08:12:46.446176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 473/933] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:46 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 18356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:46.519265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:46.519879 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:46.526651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:46.527097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:46.527891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:46.528323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:46.658877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:46.666985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-56da0d77-9804-4a95-a77d-82870202dcf7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.151390 Jan 28 08:12:46.667594 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 461/934] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:46 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:47.457329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:47.458336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:47.465295 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:47.465804 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:47.466543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:47.467016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:47.582416 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bd4485ef-6992-4464-9d92-a9b88d394476 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 19342 microversion: 2.20 time: 0.129025 Jan 28 08:12:47.583056 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 474/935] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:47 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 19342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:47.685310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:47.686060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:47.694045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:47.694510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:47.695344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:47.695783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:47.973624 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:47.981459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ed02b5dd-1fdd-41a6-8d70-bd284251adc2 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.300707 Jan 28 08:12:47.982031 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 462/936] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:47 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:48.594680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:48.595620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:48.602992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:48.603496 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:48.604273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:48.604713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:48.675656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-56dd8ce4-f1e6-4a4c-bf19-fbc0a4bad400 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 21790 microversion: 2.20 time: 0.085108 Jan 28 08:12:48.676270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 475/937] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:48 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 21790 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:48.998600 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:48.999214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:49.005894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:49.006709 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:49.007511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:49.007945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:49.137339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:49.144642 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3dbfa897-71f5-4480-a978-f0461a475bb7 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.150567 Jan 28 08:12:49.145357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 463/938] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:48 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:49.150085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-28a904a7-c2bf-4c19-b188-ce188e8cbd0c req-13a3a551-fce9-43b5-abb5-bd686e423652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923499e3-9b07-4c4f-829b-ea148e6614a8", "name": "network-vif-plugged", "status": "completed", "tag": "2417e938-c871-4a23-9a9e-55f371cf4330"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:49.151849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:49.151849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:12:49.159543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-28a904a7-c2bf-4c19-b188-ce188e8cbd0c req-13a3a551-fce9-43b5-abb5-bd686e423652 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:49.159990 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-28a904a7-c2bf-4c19-b188-ce188e8cbd0c req-13a3a551-fce9-43b5-abb5-bd686e423652 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:49.170670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-28a904a7-c2bf-4c19-b188-ce188e8cbd0c req-13a3a551-fce9-43b5-abb5-bd686e423652 service nova] Creating event network-vif-plugged:2417e938-c871-4a23-9a9e-55f371cf4330 for instance 923499e3-9b07-4c4f-829b-ea148e6614a8 on hv-cinder-80403 Jan 28 08:12:49.175552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-28a904a7-c2bf-4c19-b188-ce188e8cbd0c req-13a3a551-fce9-43b5-abb5-bd686e423652 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030108 Jan 28 08:12:49.176150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 476/939] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:12:49.686545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:49.687529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:49.693927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:49.694375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:49.695137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:49.695601 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:49.822384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f45b133b-7135-44f4-962d-390aec9af16c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 23235 microversion: 2.20 time: 0.139335 Jan 28 08:12:49.822999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 464/940] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:49 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 23235 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:50.162907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:50.163567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:50.169559 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:50.170004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:50.170765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:50.171195 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:50.302695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:50.309974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5506ebc5-8f5c-467c-bdbe-5dd555d17a1a tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1314 microversion: 2.1 time: 0.151837 Jan 28 08:12:50.310544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 477/941] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:50 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:50.834519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:50.835550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:50.842410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:50.842863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:50.843677 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:50.844112 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:50.917321 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d4253d69-8634-4b77-9675-7064d2d9a89b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 24476 microversion: 2.20 time: 0.086742 Jan 28 08:12:50.917965 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 465/942] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:50 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 24476 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:51.326480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:51.327156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:51.334120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:51.334606 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:51.335412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:51.335849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:51.458160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:51.465980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a145e009-d464-46d1-8bc5-3b2d9cd56e39 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1497 microversion: 2.1 time: 0.143731 Jan 28 08:12:51.466546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 478/943] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:51 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:51.929316 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:51.930440 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:51.937354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:51.937814 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:51.938777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:51.939021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:52.009381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f8edc79b-e915-4f07-a95b-bbb52a1cb4b0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 26057 microversion: 2.20 time: 0.084428 Jan 28 08:12:52.010006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 466/944] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:51 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 26057 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:52.257408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:52.257908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:52.264187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:52.264639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:52.265578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:52.265991 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:52.293112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:12:52.776305 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-55a0a866-2bd2-44e3-b4af-0dbe1b065eea tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "DELETE /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 204 len: 0 microversion: 2.1 time: 0.522333 Jan 28 08:12:52.777014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 479/945] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:12:52 2022] DELETE /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:12:52.785348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:52.786321 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:52.795002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:52.795002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:52.795255 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:52.795716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:52.923700 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:52.931361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f2ccf12f-a52e-4a5c-b80b-6ccba7890f37 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1503 microversion: 2.1 time: 0.150065 Jan 28 08:12:52.931932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 467/946] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:52 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:53.021526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:53.023120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:53.029471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:53.029922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:53.030729 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:53.031166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:53.102722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a14411fd-9365-4430-bde8-2275aae6db7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 27179 microversion: 2.20 time: 0.085195 Jan 28 08:12:53.103345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 480/947] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:53 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 27179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:53.948641 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:53.949199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:53.955536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:53.955995 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:53.956782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:53.957272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:54.090493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:54.097781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fe516806-e17e-476b-b787-c2ed37c8a41f tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1503 microversion: 2.1 time: 0.152938 Jan 28 08:12:54.098540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 468/948] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:53 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:54.114408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:54.115415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:54.122421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:54.122908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:54.123724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:54.124200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:54.212356 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-18dc25bc-c86a-490a-a7d2-32f933910cd6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 27814 microversion: 2.20 time: 0.101781 Jan 28 08:12:54.212911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 481/949] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:54 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 27814 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:54.873425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-bb3e3a24-ae0b-485c-a335-6de51ed36020 req-6920c385-e1bb-4cf4-80aa-1612368aff77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923499e3-9b07-4c4f-829b-ea148e6614a8", "name": "network-vif-deleted", "tag": "2417e938-c871-4a23-9a9e-55f371cf4330"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:54.874934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:12:54.874934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:12:54.882020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-bb3e3a24-ae0b-485c-a335-6de51ed36020 req-6920c385-e1bb-4cf4-80aa-1612368aff77 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:54.882462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-bb3e3a24-ae0b-485c-a335-6de51ed36020 req-6920c385-e1bb-4cf4-80aa-1612368aff77 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:54.893536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-bb3e3a24-ae0b-485c-a335-6de51ed36020 req-6920c385-e1bb-4cf4-80aa-1612368aff77 service nova] Creating event network-vif-deleted:2417e938-c871-4a23-9a9e-55f371cf4330 for instance 923499e3-9b07-4c4f-829b-ea148e6614a8 on hv-cinder-80403 Jan 28 08:12:54.898405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-bb3e3a24-ae0b-485c-a335-6de51ed36020 req-6920c385-e1bb-4cf4-80aa-1612368aff77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028794 Jan 28 08:12:54.899015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 469/950] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:12:55.115619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:55.116317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:55.123720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:55.124175 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:55.124955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:55.125419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:55.184628 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18adb6535e964ad098000131b6baa36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3a69d1c34944be9eedff8a329f3066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:55.192462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fef1e726-865b-42a9-9d0e-2ded3353b828 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 200 len: 1299 microversion: 2.1 time: 0.080969 Jan 28 08:12:55.194140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 482/951] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:55 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:55.224142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:55.225099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:55.231675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:55.236037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:55.236037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:55.236037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:55.306039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-82b5a303-36f7-4230-ba2e-b58fc21c1d17 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.085109 Jan 28 08:12:55.306721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 470/952] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:55 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:56.208224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:56.208883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] [instance: 923499e3-9b07-4c4f-829b-ea148e6614a8] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:56.215780 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.216234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.217010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.217444 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.230960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] HTTP exception thrown: Instance 923499e3-9b07-4c4f-829b-ea148e6614a8 could not be found. Jan 28 08:12:56.231570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] Returning 404 to user: Instance 923499e3-9b07-4c4f-829b-ea148e6614a8 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:12:56.232379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-662df246-35a1-4c58-900b-4665d68b0497 tempest-VolumesActionsTest-1562074400 tempest-VolumesActionsTest-1562074400-project] 10.222.0.42 "GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8" status: 404 len: 111 microversion: 2.1 time: 0.027909 Jan 28 08:12:56.232900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 483/953] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:56 2022] GET /compute/v2.1/servers/923499e3-9b07-4c4f-829b-ea148e6614a8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:12:56.318219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:56.319341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:56.326320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.326773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.327587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.328027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.389144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c49ae18f-8159-4a4b-8e25-186468a1129e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.074850 Jan 28 08:12:56.390021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 471/954] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:56 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:56.646930 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:56.647874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:56.654639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.655092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.655984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.656419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.684474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3eef2642-75a7-4e9c-ae35-33c7d823cbc8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041250 Jan 28 08:12:56.685040 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 484/955] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:12:56 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:12:56.752608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:56.753193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:56.760619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.761070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.761843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:56.762277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:56.788146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:12:57.085282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1b77cef2-9de0-4ca6-a82b-5908f355f873 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 204 len: 0 microversion: 2.1 time: 0.336263 Jan 28 08:12:57.086287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 472/956] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:12:56 2022] DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:12:57.095435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:57.095435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:57.101166 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:57.101619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:57.102401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:57.102833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:57.230363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:57.237652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b85fbf8b-6cc7-42f4-9a27-f188ae76e986 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1673 microversion: 2.1 time: 0.147084 Jan 28 08:12:57.243407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 485/957] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:57 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:57.401277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:57.402291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:57.409398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:57.409857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:57.410638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:57.411387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:57.474008 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bb49c2f9-5d0a-4078-a82d-c7ed0542e8ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.076848 Jan 28 08:12:57.478468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 473/958] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:57 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:12:58.255222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:58.255880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:58.262396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:58.264504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:58.264504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:58.264504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:58.390385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:58.397600 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-17e6f06e-fcaf-4f45-be0b-f3cb4b035cc4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1673 microversion: 2.1 time: 0.146150 Jan 28 08:12:58.398163 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 486/959] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:58 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:12:58.486453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:12:58.487492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:58.494831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:58.495309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:58.496089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:58.496528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:59.414749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:12:59.415433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:12:59.422352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:59.422810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:59.423633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:12:59.424079 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:12:59.550767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:12:59.558076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fb8af0d4-7750-4ea7-b4fd-a28bd6b155bd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1673 microversion: 2.1 time: 0.147318 Jan 28 08:12:59.558638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 487/960] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:12:59 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:13:00.574884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:00.575584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:00.581704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:00.586446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:00.586446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:00.586446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:00.716975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:00.724222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e7465f19-2d91-43e7-8fdf-a733db347238 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1673 microversion: 2.1 time: 0.153219 Jan 28 08:13:00.724787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 488/961] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:00 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:13:01.663750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-93e2d619-d040-49fb-b7ca-7b0e034784a4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 3.181187 Jan 28 08:13:01.664406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 474/962] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:12:58 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 3183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:01.741131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:01.741817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:01.748464 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:01.752703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:01.754099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:01.754728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:01.888280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:01.895626 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d850bced-34d7-4a4f-afc2-1dc2bcd5358c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1673 microversion: 2.1 time: 0.158139 Jan 28 08:13:01.896391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 489/963] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:01 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:02.605876 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-02b25c4b-6e24-44db-94bd-bece9f7efaac req-d3b641b9-8601-4814-be24-88428f440d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab426f8-a759-4d28-b87b-c5a029df5761", "name": "network-vif-deleted", "tag": "475d6a57-bcb8-44c5-b348-83a41470900b"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:02.609910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:13:02.609910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:13:02.617776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-02b25c4b-6e24-44db-94bd-bece9f7efaac req-d3b641b9-8601-4814-be24-88428f440d9a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.618215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-02b25c4b-6e24-44db-94bd-bece9f7efaac req-d3b641b9-8601-4814-be24-88428f440d9a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.632947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-02b25c4b-6e24-44db-94bd-bece9f7efaac req-d3b641b9-8601-4814-be24-88428f440d9a service nova] Creating event network-vif-deleted:475d6a57-bcb8-44c5-b348-83a41470900b for instance 7ab426f8-a759-4d28-b87b-c5a029df5761 on hv-cinder-80403 Jan 28 08:13:02.640048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-02b25c4b-6e24-44db-94bd-bece9f7efaac req-d3b641b9-8601-4814-be24-88428f440d9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041693 Jan 28 08:13:02.640645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 475/964] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:13:02.675439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:02.676368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:02.682877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.683429 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.684286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.684726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.755017 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e8726bef-d54a-445e-94cc-ff14998b2dfa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.083143 Jan 28 08:13:02.759514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 490/965] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:02 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:02.913556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:02.914445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:02.922648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.923118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.924163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.924682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.959883 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:02.960344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:02.960796 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lazy-loading 'fault' on Instance uuid 7ab426f8-a759-4d28-b87b-c5a029df5761 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:13:03.012928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:03.020552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-09ee2aaa-d27a-45e3-bbb2-803f6ec36067 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 200 len: 1328 microversion: 2.1 time: 0.111569 Jan 28 08:13:03.021124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 476/966] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:02 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:03.767089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:03.768855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:03.782143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:03.783234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:03.785114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:03.787068 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:03.886471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-eee50dda-52f8-4e35-a349-68676a363679 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.123148 Jan 28 08:13:03.888737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 491/967] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:03 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:04.043646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:04.045219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:04.053318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:04.054213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:04.055219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:04.056010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:04.070897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. Jan 28 08:13:04.072436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:13:04.073489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-34ee1458-eb93-4dfd-a9ea-d148aa1c88e2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 404 len: 111 microversion: 2.1 time: 0.034099 Jan 28 08:13:04.074543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 477/968] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:04 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:13:04.086546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b2a8fc4b-c8ee-4171-8d04-870142b5f9c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '.version_select at 0x7f34783b0280>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:04.155006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b2a8fc4b-c8ee-4171-8d04-870142b5f9c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554948144" status: 202 len: 0 microversion: 2.1 time: 0.072210 Jan 28 08:13:04.155842 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 492/969] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jan 28 08:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554948144 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:04.900561 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:04.901483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:04.909059 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:04.909750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:04.910986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:04.911542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:04.982547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-73bf3506-d33d-42a4-9d9f-87fe802097e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.085595 Jan 28 08:13:04.983969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 478/970] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:04 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:05.114881 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: .version_select at 0x7f346fed73a0>, body: {"keypair": {"name": "tempest-keypair-1584894007"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:05.129344 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:13:05.133384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:13:05.804475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:13:05.810249 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:13:05.828152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1dfd4e9f-9eda-4882-bd96-2a0d71f4f525 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.716902 Jan 28 08:13:05.828956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 493/971] 10.222.0.42 () {60 vars in 1157 bytes} [Fri Jan 28 08:13:05 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:05.995110 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:05.996196 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:06.003918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:06.007403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:06.007403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:06.007403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:06.072000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c013840a-d57f-4ec6-9255-b627a1e491b3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.081258 Jan 28 08:13:06.073256 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 479/972] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:05 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:07.086718 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:07.088113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:07.096177 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:07.096977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:07.097982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:07.098657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:07.167227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b307ef71-9dc8-4600-99c9-0af8e5a4bbec tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.083860 Jan 28 08:13:07.172855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 494/973] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:07 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:08.183163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:08.185838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:08.195060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:08.196422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:08.197816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:08.198257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:08.280927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0680be02-aba5-4663-b118-306aae482542 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.104628 Jan 28 08:13:08.283288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 480/974] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:08 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:08.298187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1721685919", "imageRef": "b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5631824c-d1c4-4260-a605-4dc536d16870"}], "security_groups": [{"name": "tempest-securitygroup--409158609"}], "key_name": "tempest-keypair-1584894007", "user_data": "}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:08.430928 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] validate_networks() for [('5631824c-d1c4-4260-a605-4dc536d16870', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:13:08.887969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:13:08.888508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:13:08.889070 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:13:08.889562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:13:08.890084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:13:08.900938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:08.901486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:08.902394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:08.902911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:08.922282 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:13:08.926935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Getting quotas for user db1f93eeb1fc477abcca365e18da11db and project ff87d44e98bd466eabc90ba36bc969c9. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:13:08.940317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:13:08.942713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4d19555-f5c6-4d6e-9f8d-51d86cdd67c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:13:09.295101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:09.296272 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:09.303234 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:09.303729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:09.304788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:09.305421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:09.310748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8f7bada7-b5b2-4099-b4ee-95df715cd554 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.017283 Jan 28 08:13:09.312039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 495/975] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:13:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:13:09.334099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4f2be28f-de23-4392-8d08-023ce5670de9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:09.334746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4f2be28f-de23-4392-8d08-023ce5670de9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:09.424736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4f2be28f-de23-4392-8d08-023ce5670de9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:09.439979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-89029602-fc79-4faf-b088-0347a0bee634 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.149340 Jan 28 08:13:09.441180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 481/976] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:09 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:09.450205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4f2be28f-de23-4392-8d08-023ce5670de9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1238 microversion: 2.1 time: 0.118730 Jan 28 08:13:09.453644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 496/977] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:09 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:10.454514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:10.456498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:10.464504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:10.470024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:10.471291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:10.474460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:10.477309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:10.479771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:10.484582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:10.484582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:10.485080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:10.488184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:10.555488 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ff2c29c4-5592-455a-b782-01843ca78761 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.104791 Jan 28 08:13:10.556337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 482/978] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:10 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:10.572805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:10.580756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-90927e99-6d7c-4970-8f07-55348c9c178e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1234 microversion: 2.1 time: 0.113949 Jan 28 08:13:10.594390 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 497/979] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:10 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1234 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:13:11.569621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:11.571396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:11.581702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:11.582930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:11.587540 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:11.588115 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:11.607653 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:11.609677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:11.617828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:11.620008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:11.621221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:11.621835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:11.678856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a18eca19-1258-490b-89ad-d484858018a6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.114116 Jan 28 08:13:11.683772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 483/980] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:11 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:11.705563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:11.713373 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9ad1bb34-1016-4a7b-9144-7f0068622e02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1296 microversion: 2.1 time: 0.115026 Jan 28 08:13:11.714627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 498/981] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:11 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:13:12.692444 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:12.696958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:12.707647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:12.708194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:12.709173 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:12.709842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:12.730064 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:12.731954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:12.743171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:12.750779 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:12.751679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:12.752118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:12.801798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a3106680-1004-4123-869c-002b6c6be4cd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.113439 Jan 28 08:13:12.808182 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 484/982] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:12 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:12.899840 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:12.908844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e0f6d7a0-79e4-4c87-a362-7d28416adb35 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.182478 Jan 28 08:13:12.909418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 499/983] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:12 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:13:13.342445 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-4bf9545b-d80f-440e-b4b0-bf49557879cc req-5cc7e747-a634-4604-b7fe-a5ba1a933bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4c3136-3f76-4a8e-94fd-ae717389411f", "tag": "f634e38e-0b18-4dac-88a9-1f25244d0fe3"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:13.346497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:13:13.346497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:13:13.356299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-4bf9545b-d80f-440e-b4b0-bf49557879cc req-5cc7e747-a634-4604-b7fe-a5ba1a933bf0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:13.356822 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-4bf9545b-d80f-440e-b4b0-bf49557879cc req-5cc7e747-a634-4604-b7fe-a5ba1a933bf0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:13.370569 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-4bf9545b-d80f-440e-b4b0-bf49557879cc req-5cc7e747-a634-4604-b7fe-a5ba1a933bf0 service nova] Creating event network-changed:f634e38e-0b18-4dac-88a9-1f25244d0fe3 for instance 3c4c3136-3f76-4a8e-94fd-ae717389411f on hv-cinder-80403 Jan 28 08:13:13.376142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-4bf9545b-d80f-440e-b4b0-bf49557879cc req-5cc7e747-a634-4604-b7fe-a5ba1a933bf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043118 Jan 28 08:13:13.383094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 485/984] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:13:13.814892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:13.815895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:13.823884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:13.825013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:13.825813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:13.826254 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:13.888214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0f9bb631-263c-4541-959c-fdc53dd7f26e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28180 microversion: 2.20 time: 0.076770 Jan 28 08:13:13.888848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 500/985] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:13 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28180 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:13.927570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:13.929355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:13.938180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:13.938880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:13.939942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:13.940725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:14.189750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:14.200822 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-36928b20-0f57-427d-969a-2ef12faa252e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.278249 Jan 28 08:13:14.201794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 486/986] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:13 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:14.901059 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:14.902155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:14.908935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:14.909380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:14.910158 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:14.910854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:14.994231 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b82d72b7-ed65-44eb-a1c1-6ed21edcf62e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28469 microversion: 2.20 time: 0.097556 Jan 28 08:13:14.998085 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 501/987] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:14 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28469 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:15.218498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:15.219030 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:15.225590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:15.226054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:15.260823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:15.260823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:15.364123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:15.371482 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f8c0f0e3-448b-4c20-b3f5-013f8250fb2a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.156755 Jan 28 08:13:15.372050 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 487/988] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:15 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:16.007489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:16.009613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:16.019839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:16.020766 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:16.021894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:16.022754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:16.121465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ab26ce56-4e00-4948-8f6f-d531505bb8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28471 microversion: 2.20 time: 0.118720 Jan 28 08:13:16.122415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 502/989] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:16 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:16.388185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:16.389960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:16.397007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:16.397473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:16.398274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:16.398720 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:16.539485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:16.547685 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5bb89efc-eb1e-4b78-a735-94c60649b91e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.163250 Jan 28 08:13:16.557177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 488/990] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:16 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:17.134115 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:17.135864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:17.142987 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:17.144114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:17.145136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:17.145772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:17.225961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3c3f5916-5740-4446-b770-746fd1b8d50b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28612 microversion: 2.20 time: 0.095620 Jan 28 08:13:17.236878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 503/991] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:17 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:17.564624 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:17.565315 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:17.572631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:17.573094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:17.573890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:17.574333 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:17.735530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:17.744850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fff2ad2d-3536-4218-a56d-2281350b572c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.183936 Jan 28 08:13:17.745837 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 489/992] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:17 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:18.246833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:18.248224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:18.256598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:18.257055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:18.257872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:18.258304 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:18.333648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-563f0bb2-3c47-4d0a-b396-b1b47c94cb21 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.090825 Jan 28 08:13:18.334449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 504/993] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:18 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:18.764475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:18.766939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:18.774168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:18.774729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:18.778024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:18.778912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:18.921226 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:18.929366 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8e4c2168-d915-42af-9631-a48af824c1c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.171257 Jan 28 08:13:18.935363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 490/994] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:18 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:19.345177 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:19.346957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:19.356916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:19.356916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:19.356916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:19.356916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:19.418615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a3afddda-5b79-4304-9a89-5a9cdb3ebeaf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.077443 Jan 28 08:13:19.420327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 505/995] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:19 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:19.945802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:19.946330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:19.952724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:19.953184 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:19.953962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:19.954404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:20.078491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:20.085692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c1bd4714-713c-4d9b-9080-0e8c1349c9ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.143716 Jan 28 08:13:20.086259 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 491/996] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:19 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:20.430668 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:20.431742 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:20.438681 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:20.439136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:20.439998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:20.440433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:20.500869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8a129b99-2798-4de5-b69a-101a9920a99b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.074138 Jan 28 08:13:20.501586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 506/997] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:20 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:21.101657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:21.102271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:21.108603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:21.109136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:21.109854 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:21.110292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:21.250047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:21.258717 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f1490071-f83a-4f2c-b209-1b2859be5fe8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.160655 Jan 28 08:13:21.259966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 492/998] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:21 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:21.467697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-67032ee9-416a-4591-8ea4-a7f70594713a req-6fa491b3-b214-4f88-8c96-58eaadcc505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4c3136-3f76-4a8e-94fd-ae717389411f", "name": "network-vif-plugged", "status": "completed", "tag": "f634e38e-0b18-4dac-88a9-1f25244d0fe3"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:21.469211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:13:21.469211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:13:21.476951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-67032ee9-416a-4591-8ea4-a7f70594713a req-6fa491b3-b214-4f88-8c96-58eaadcc505a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:21.477393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-67032ee9-416a-4591-8ea4-a7f70594713a req-6fa491b3-b214-4f88-8c96-58eaadcc505a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:21.492176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-67032ee9-416a-4591-8ea4-a7f70594713a req-6fa491b3-b214-4f88-8c96-58eaadcc505a service nova] Creating event network-vif-plugged:f634e38e-0b18-4dac-88a9-1f25244d0fe3 for instance 3c4c3136-3f76-4a8e-94fd-ae717389411f on hv-cinder-80403 Jan 28 08:13:21.495102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-67032ee9-416a-4591-8ea4-a7f70594713a req-6fa491b3-b214-4f88-8c96-58eaadcc505a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031344 Jan 28 08:13:21.495778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 507/999] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:13:21.514111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:21.518833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:21.522415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:21.522575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:21.523346 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:21.523798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:21.598305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fec49174-e67e-4ca5-aa89-ec84738c844f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.087893 Jan 28 08:13:21.598916 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 493/1000] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:21 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:22.277384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:22.278082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:22.284174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:22.284632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:22.285675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:22.286179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:22.418998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:22.426279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f1f4223e-5d97-45ad-a28b-6ee4fae88a3c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1363 microversion: 2.1 time: 0.154216 Jan 28 08:13:22.426851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 508/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:22 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:22.610677 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:22.611736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:22.619364 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:22.619687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:22.620510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:22.620954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:22.690389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e469cef4-5e5c-4256-a09f-70056ac4d7d9 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.083637 Jan 28 08:13:22.694474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 494/1002] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:22 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:23.443323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:23.443947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:23.450773 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.451230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.452232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.452680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.603893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:13:23.611975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4cbdc8a1-05ba-451b-84f0-ffd081ecb1c1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1548 microversion: 2.1 time: 0.172050 Jan 28 08:13:23.612549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 509/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:13:23 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:23.628250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:13:23.628863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:23.636184 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.636636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.637452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.637886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.702509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:23.703709 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:23.710112 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.710560 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.711381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:23.711828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:23.719239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5c3802f2-db50-456e-8220-67b91f264750 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094918 Jan 28 08:13:23.719873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 495/1004] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jan 28 08:13:23 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:13:23.793634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f0cb19e7-c30f-4dc1-89f0-4eb47b02815e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.094087 Jan 28 08:13:23.796164 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 510/1005] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:23 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:24.769877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:24.771526 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:24.775386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-c7ec3b44-d1b6-47fd-86bd-9a5e035f3011 req-51115758-2c03-4efa-934d-a12a0625dbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4c3136-3f76-4a8e-94fd-ae717389411f", "tag": "f634e38e-0b18-4dac-88a9-1f25244d0fe3"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:24.777190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:13:24.777190 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:13:24.778323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:24.778783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:24.779618 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:24.780070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:24.785496 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-c7ec3b44-d1b6-47fd-86bd-9a5e035f3011 req-51115758-2c03-4efa-934d-a12a0625dbd7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:24.785943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-c7ec3b44-d1b6-47fd-86bd-9a5e035f3011 req-51115758-2c03-4efa-934d-a12a0625dbd7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:24.798024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-c7ec3b44-d1b6-47fd-86bd-9a5e035f3011 req-51115758-2c03-4efa-934d-a12a0625dbd7 service nova] Creating event network-changed:f634e38e-0b18-4dac-88a9-1f25244d0fe3 for instance 3c4c3136-3f76-4a8e-94fd-ae717389411f on hv-cinder-80403 Jan 28 08:13:24.803879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-c7ec3b44-d1b6-47fd-86bd-9a5e035f3011 req-51115758-2c03-4efa-934d-a12a0625dbd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032962 Jan 28 08:13:24.804756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 511/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:13:24.810441 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:24.811454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:24.818160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:24.818608 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:24.819433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:24.819876 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:24.843755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d9a9755d-d5a3-4b3f-869d-d68bb0873a97 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.078978 Jan 28 08:13:24.844815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 496/1007] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:24 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:24.890117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9a670410-e058-401c-ba05-df67d2adc62c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.083404 Jan 28 08:13:24.891041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 512/1008] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:24 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:25.855673 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:25.856682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:25.863575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:25.864033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:25.864815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:25.865282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:25.906678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:25.907833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:25.916177 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:25.916412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:25.917208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:25.917650 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:25.928672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1c7f1a74-7242-42c1-9c60-5729d3f5a728 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.077581 Jan 28 08:13:25.929529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 497/1009] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:25 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:25.979178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d13c9cf4-fda1-4fdf-8864-bc8f1f1a0370 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.076344 Jan 28 08:13:25.983006 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 513/1010] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:25 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:26.942226 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:26.945136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:26.955545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:26.956287 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:26.957106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:26.957547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:26.990659 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:26.991855 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:26.999506 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:26.999983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:27.000835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:27.001349 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:27.023598 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-89905f1e-f0fa-4215-b56e-15f17beb1368 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.086511 Jan 28 08:13:27.024370 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 498/1011] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:26 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:27.076070 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1af9e909-d0be-4833-b086-6dfa21b63c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.089216 Jan 28 08:13:27.076747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 514/1012] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:26 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:28.035712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:28.036967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:28.044403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:28.044853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:28.045670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:28.046108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:28.088335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:28.089327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:28.096650 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:28.097101 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:28.097880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:28.098322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:28.106600 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-475d676e-17e3-4bf0-a765-4d7f1e04bd57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.075018 Jan 28 08:13:28.109780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 499/1013] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:28 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:28.161126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3b458ec1-520e-43e7-9d26-c3a8e06628a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.076630 Jan 28 08:13:28.162184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 515/1014] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:28 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:29.117374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:29.118425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:29.126087 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:29.126545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:29.127363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:29.127807 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:29.173513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:29.174512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:29.181331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:29.181790 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:29.182564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:29.183005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:29.187977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fe918a97-cee4-4622-ad6a-408bd93259ec tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.074501 Jan 28 08:13:29.188755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 500/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:29 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:29.248929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0b790927-6108-4960-a940-d669b7c5ff96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.079379 Jan 28 08:13:29.249596 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 516/1016] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:29 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:30.198465 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:30.200161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:30.207081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:30.207563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:30.208348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:30.208792 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:30.260573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:30.261572 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:30.266761 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-65686700-f0d1-41de-a5fd-d207f3b467b6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.072195 Jan 28 08:13:30.269930 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 501/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:30 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:30.270082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:30.270082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:30.270434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:30.270927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:30.333070 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e64a5e6c-e464-4f35-b6a3-061112408a1a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.076443 Jan 28 08:13:30.333757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 517/1018] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:30 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:31.278249 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:31.279339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:31.286552 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:31.287007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:31.287902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:31.288320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:31.345458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:31.346485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:31.349767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-98b7dacd-dcc2-4fb8-808b-64c325afd0a4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.075455 Jan 28 08:13:31.350535 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 502/1019] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:31 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:31.353494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:31.353952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:31.354737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:31.355178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:31.426615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e40d1716-8b29-4ae2-97b9-9e5492679193 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.085154 Jan 28 08:13:31.427184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 518/1020] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:31 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:32.361122 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:32.362160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:32.369175 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:32.369641 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:32.370454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:32.370895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:32.431622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-06211a1f-acba-4652-ae3d-e100d8e344dc tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.074342 Jan 28 08:13:32.432546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 503/1021] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:32 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:32.438436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:32.439601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:32.446445 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:32.446900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:32.447755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:32.448198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:32.514772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-aa84124a-a623-4155-8dfd-5233aef75d24 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.078965 Jan 28 08:13:32.514772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 519/1022] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:32 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:33.442521 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:33.443481 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:33.450625 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:33.451079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:33.451909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:33.452354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:33.509314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-378ceba8-1b5b-4805-bb29-1a60c66adc57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.070642 Jan 28 08:13:33.509862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 504/1023] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:33 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:33.525699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:33.526696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:33.535176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:33.535668 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:33.536453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:33.536881 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:33.605599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7270e7bb-27db-4da1-b9b3-5e8b03addb20 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.083786 Jan 28 08:13:33.606923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 520/1024] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:33 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:34.520716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:34.521713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:34.528519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:34.528968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:34.529728 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:34.530160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:34.589672 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1d0c0bbb-998d-4e1b-a398-b3aac7d4d5f7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.072673 Jan 28 08:13:34.590236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 505/1025] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:34 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 08:13:34.618318 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:34.619346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:34.627062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:34.627569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:34.628362 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:34.628805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:34.695217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7672ee51-05d3-4d32-b1d5-14ea8948cd1c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.080780 Jan 28 08:13:34.695901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 521/1026] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:34 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:35.601189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:35.602197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:35.609076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:35.609530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:35.610305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:35.611082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:35.668265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e870e13c-78e2-41da-928e-8b77c97e6ce9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 14 microversion: 2.1 time: 0.071068 Jan 28 08:13:35.668884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 506/1027] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:35 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:13:35.707299 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:35.708291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:35.715731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:35.716185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:35.716951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:35.717382 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:35.788549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d59e5b1d-21e3-4071-b309-1766f9f5661f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.085214 Jan 28 08:13:35.789177 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 522/1028] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:35 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:36.678929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:36.680000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:36.686529 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:36.686989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:36.687802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:36.688244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:36.758787 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1a93124a-5488-41c2-8c2c-a6908b9718eb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 9658 microversion: 2.1 time: 0.083925 Jan 28 08:13:36.759434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 507/1029] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:36 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 9658 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:13:36.800697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:36.801679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:36.808732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:36.809178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:36.810014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:36.810448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:36.870792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-19533937-c99d-48b4-a792-6c48eaa73dc3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.073924 Jan 28 08:13:36.871527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 523/1030] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:36 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:37.770375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:37.771416 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:37.778263 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:37.778715 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:37.779518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:37.779958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:37.852699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-81869772-07e4-4454-88b2-55788ac035a5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 16411 microversion: 2.1 time: 0.086244 Jan 28 08:13:37.853559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 508/1031] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:37 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 16411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:37.884306 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:37.885281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:37.892082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:37.892524 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:37.893285 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:37.893716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:37.965245 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bae7cfde-940f-4ae0-8c3b-2f98ce9284a5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.084660 Jan 28 08:13:37.966061 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 524/1032] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:37 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:38.864927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:38.865932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:38.873214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:38.873665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:38.874432 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:38.874864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:38.954152 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-171abe8a-f17c-493b-beeb-a23e89af903b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 18083 microversion: 2.1 time: 0.093116 Jan 28 08:13:38.954810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 509/1033] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:38 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 18083 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:38.977122 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:38.978120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:38.985051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:38.985499 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:38.986268 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:38.986703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:39.054315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6f80c624-23d0-4e02-96f3-009f4000d27f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.081133 Jan 28 08:13:39.054930 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 525/1034] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:38 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:39.966383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:39.967349 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:39.974135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:39.974585 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:39.975383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:39.975824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:40.046994 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3c83c7da-7815-494b-a0d2-61345e892acd tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 19944 microversion: 2.1 time: 0.085308 Jan 28 08:13:40.047686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 510/1035] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:39 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 19944 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:40.066614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:40.067654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:40.074979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:40.075473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:40.076250 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:40.076691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:40.145711 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c4d69d97-8e2e-4cd9-af13-9bbb9b08107a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.083045 Jan 28 08:13:40.146335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 526/1036] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:40 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:41.057920 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:41.058927 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:41.065778 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:41.066235 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:41.067028 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:41.067495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:41.138882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3855eab3-e55f-4d00-ae95-2a1736b347f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 22666 microversion: 2.1 time: 0.084977 Jan 28 08:13:41.139537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 511/1037] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:41 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 22666 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:41.157384 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:41.158379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:41.165669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:41.166119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:41.166895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:41.167460 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:41.227066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1c049bd7-bfde-4ea4-a945-f93cfd386fb8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.074203 Jan 28 08:13:41.227720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 527/1038] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:41 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:42.150731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:42.151784 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:42.158563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:42.159010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:42.160153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:42.160592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:42.228547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2b0b0d44-59d1-4ece-bfe2-0fa6e70e1900 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 23235 microversion: 2.1 time: 0.081731 Jan 28 08:13:42.229161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 512/1039] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:42 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 23235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:42.244715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:42.245713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:42.254203 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:42.254653 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:42.255484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:42.255925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:42.329182 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14ae3bed-b258-400d-b614-76b551f55e56 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.088270 Jan 28 08:13:42.329826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 528/1040] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:42 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:43.245948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:43.246991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:43.254716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:43.255174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:43.255990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:43.256435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:43.331076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-19e6d04d-e1f0-4391-8dad-8a1dba56e4cb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 24550 microversion: 2.1 time: 0.089142 Jan 28 08:13:43.331810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 513/1041] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:43 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 24550 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:43.341106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:43.342141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:43.349138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:43.349593 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:43.350367 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:43.350807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:43.426583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d4bf9c70-2032-4b76-9cfd-9d45b553f342 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.089401 Jan 28 08:13:43.427217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 529/1042] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:43 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:44.343054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:44.344134 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:44.350943 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:44.353611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:44.353611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:44.353611 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:44.433492 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-79626cb5-2d9d-4f8a-a951-8d66fec1371b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 26015 microversion: 2.1 time: 0.095026 Jan 28 08:13:44.434843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 514/1043] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:44 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 26015 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:44.438474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:44.439497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:44.446325 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:44.446774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:44.447575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:44.448013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:44.506851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4d2f2e6c-7e8d-498f-ad66-d0fc36d3ec95 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.072301 Jan 28 08:13:44.507657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 530/1044] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:44 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:45.444721 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:45.445729 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:45.452671 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:45.453125 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:45.453905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:45.454346 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:45.518348 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:45.519386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:45.526180 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:45.526627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:45.527435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:45.527867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:45.527969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-055a051e-ceaa-43ff-b447-89c21421e48c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 27085 microversion: 2.1 time: 0.087222 Jan 28 08:13:45.532048 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 515/1045] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:45 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 27085 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:45.587616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-eaf5f479-22d1-476a-87fa-f6e7c9b0b913 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.073027 Jan 28 08:13:45.588152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 531/1046] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:45 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:46.540625 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:46.541628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:46.549080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:46.549530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:46.550303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:46.550737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:46.599683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:46.600611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:46.607443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:46.608399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:46.609227 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:46.609662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:46.634439 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-82c40536-7737-4196-ab27-20eee1b01d1c tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 27653 microversion: 2.1 time: 0.097728 Jan 28 08:13:46.635088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 516/1047] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:46 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 27653 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:46.678340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d6395c0a-3c33-43db-9412-e45f9d7506fb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.082753 Jan 28 08:13:46.678970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 532/1048] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:46 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:47.646933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:47.647885 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:47.654699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:47.655750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:47.656537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:47.656983 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:47.690962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:47.692000 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:47.698950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:47.699609 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:47.700392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:47.700830 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:47.735143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-20414565-0e44-4f56-b0a1-8154b7042c5e tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 27903 microversion: 2.1 time: 0.092240 Jan 28 08:13:47.735968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 517/1049] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:47 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 27903 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:47.788653 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bcf881f4-4815-4974-b042-b9880c066829 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.102098 Jan 28 08:13:47.789316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 533/1050] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:47 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:48.747827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:48.748746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:48.755708 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:48.756164 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:48.756945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:48.757388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:48.801833 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:48.802826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:48.809633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:48.810078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:48.810846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:48.811312 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:48.829767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-962d8b7c-c54f-4f34-ba13-27fac45d2d42 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.085949 Jan 28 08:13:48.833765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 518/1051] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:48 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:48.872214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-67d2000d-27af-42a7-a626-2cd8422a3510 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.074312 Jan 28 08:13:48.872872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 534/1052] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:48 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:49.841597 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:49.843191 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:49.850225 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:49.850679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:49.851485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:49.851928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:49.885765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:49.886759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:49.893971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:49.894418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:49.895192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:49.895655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:49.923112 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f6679dfe-4674-431c-9bae-c9fce8196e91 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.085520 Jan 28 08:13:49.924541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 519/1053] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:49 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:49.955222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-df333230-724d-48ab-bb27-084b40497e5d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.073617 Jan 28 08:13:49.955873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 535/1054] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:49 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:50.935424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:50.936403 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:50.943205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:50.943690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:50.944462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:50.944899 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:50.966465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:50.968135 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:50.974944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:50.975437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:50.976217 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:50.976652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:52.286643 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cf4f42eb-9530-4622-a463-28f4bb25ca36 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 1.355173 Jan 28 08:13:52.287310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 520/1055] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:50 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:13:53.298987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:53.300019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:53.309281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:53.313723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:53.313723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:53.313723 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:53.597181 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7b211047-d4ca-47f0-9da4-014aa85dbffa tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 2.634570 Jan 28 08:13:53.598526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 536/1056] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:50 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:13:53.627964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c3a50c9d-860c-4e71-9eef-d359cdb27b4f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.333294 Jan 28 08:13:53.628606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 521/1057] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:53 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:13:54.609453 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:54.610960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:54.618540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:54.618997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:54.619817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:54.620258 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:54.639649 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:54.640682 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:54.647631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:54.648085 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:54.648861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:54.649299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:54.678908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fcb4d9c9-09dd-4ef4-b184-2c278ec6f741 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.073458 Jan 28 08:13:54.679615 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 537/1058] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:54 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:54.717635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a9b12ce1-994c-4300-8bdd-0784d65b5a8b tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.082006 Jan 28 08:13:54.718250 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 522/1059] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:54 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:13:55.691024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:55.692065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:55.698803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:55.699274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:55.700031 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:55.700461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:55.730094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:55.731118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:55.738539 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:55.739028 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:55.739844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:55.740295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:55.760756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6a6eecc2-5176-4661-9d26-f0fe8727d8a2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.074247 Jan 28 08:13:55.764808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 538/1060] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:55 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:55.806660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c1f03b8b-b8f2-47f5-ad69-08270bd49b9f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.080551 Jan 28 08:13:55.807418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 523/1061] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:55 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:13:56.772962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:56.773859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:56.780625 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:56.781069 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:56.781835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:56.782263 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:56.818861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:56.819897 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:56.826656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:56.827118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:56.827925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:56.828383 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:56.846097 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-01193229-d9fb-428e-a4be-59f014a3cbc7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.077612 Jan 28 08:13:56.846764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 539/1062] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:56 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:56.886933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0690639d-fcab-4239-bba2-514519d00a04 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.072483 Jan 28 08:13:56.887614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 524/1063] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:56 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:13:57.858684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:57.859706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:57.866498 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:57.866972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:57.867771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:57.868204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:57.900325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:57.901322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:57.910653 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:57.911201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:57.912070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:57.912070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:57.929359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-703fd7a2-4eaf-4a65-934f-e5d853a2fc11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.075361 Jan 28 08:13:57.933750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 540/1064] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:57 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:57.978146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a0910d06-7838-4302-9821-46ec8fb5b3a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.083122 Jan 28 08:13:57.978795 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 525/1065] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:57 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:13:58.943154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:58.944280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:58.953136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:58.953587 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:58.954378 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:58.954808 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:59.000053 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:13:59.001696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:13:59.008056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:59.008516 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:59.009300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:13:59.009740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:13:59.039913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7c51c31c-e81d-464a-8432-2561f64d18df tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 28639 microversion: 2.20 time: 0.101849 Jan 28 08:13:59.042033 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 541/1066] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:13:58 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 28639 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:13:59.073785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4810eed0-1a7d-4f0d-bbf1-b655284a58e9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.077577 Jan 28 08:13:59.074498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 526/1067] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:13:58 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:00.053509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:00.054528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:00.061725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:00.062171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:00.062940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:00.063404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:00.085320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:00.086330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:00.094676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:00.095135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:00.095966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:00.096412 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:00.143047 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-80d68893-f54b-4d56-85dc-0a5f47698139 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 29752 microversion: 2.20 time: 0.094680 Jan 28 08:14:00.144030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 542/1068] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:00 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 29752 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:14:00.172674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1e17215d-8f6f-476b-a6fa-1e149c21fb59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.091572 Jan 28 08:14:00.173330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 527/1069] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:00 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:01.156168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:01.157188 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:01.164818 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:01.165272 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:01.166071 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:01.166512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:01.185382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:01.186533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:01.195811 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:01.196439 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:01.197429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:01.197894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:01.246648 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b8368384-0772-42d9-bca7-85d1a6298e5c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 31824 microversion: 2.20 time: 0.094700 Jan 28 08:14:01.251330 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 543/1070] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:01 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 31824 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:14:01.273415 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-63e3795c-5567-4d7e-a1fc-355d0b31a6f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.092405 Jan 28 08:14:01.277619 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 528/1071] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:01 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:02.259655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:02.260651 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:02.267575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:02.268629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:02.268806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:02.269219 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:02.286025 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:02.287109 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:02.294116 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:02.294615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:02.295491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:02.296020 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:05.514983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-18799132-d274-4906-a4ec-da02ea1f7895 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 37049 microversion: 2.20 time: 3.259259 Jan 28 08:14:05.516266 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 544/1072] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:02 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 37049 bytes in 3261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:14:05.519420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-833979c0-19cf-4814-bc8c-65c70bca70d1 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 3.237491 Jan 28 08:14:05.520067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 529/1073] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:02 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 3239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:06.527922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:06.528930 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:06.530936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:06.532001 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:06.536966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:06.537425 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:06.538215 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:06.538655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:06.540258 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:06.540710 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:06.541489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:06.541935 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:06.615405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-049dbb9f-bcad-4fbb-8804-12ce6a6322ee tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 38185 microversion: 2.20 time: 0.092873 Jan 28 08:14:06.616212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 545/1074] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:06 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 38185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:14:06.618081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-28a94352-459a-4f88-9356-ed694409df60 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.091429 Jan 28 08:14:06.618744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 530/1075] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:06 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:07.628971 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:07.629979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:07.631066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:07.632193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:07.637019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:07.637476 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:07.638273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:07.638716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:07.639277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:07.639803 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:07.640657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:07.641177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:07.703576 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bd7cad32-1e01-41d1-b371-a0bc8cc17b70 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.077566 Jan 28 08:14:07.707547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 531/1076] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:07 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:07.709363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-71bc7e4d-3eef-42d3-87cf-0730a4ce6e96 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 38185 microversion: 2.20 time: 0.085352 Jan 28 08:14:07.710003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 546/1077] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:07 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 38185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:14:08.715381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:08.716390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:08.723831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:08.724288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:08.725072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:08.725518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:08.726965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:08.727997 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:08.734792 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:08.735271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:08.736054 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:08.737060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:08.786803 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a828f922-9067-425c-bc4f-3aaa240b7f66 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.075350 Jan 28 08:14:08.787719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 532/1078] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:08 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:08.804161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1b4fc181-f61e-449d-9a90-52fc6d6df70b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 38185 microversion: 2.20 time: 0.081216 Jan 28 08:14:08.805007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 547/1079] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:08 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 38185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:14:09.799418 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:09.800420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:09.807204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:09.807688 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:09.808462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:09.808900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:09.816901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:09.817952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:09.824734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:09.825191 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:09.825999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:09.826438 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:09.875717 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-406856c6-1dfd-4d88-a001-9b8a8a9c29e0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.080723 Jan 28 08:14:09.876795 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 533/1080] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:09 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:09.890135 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2febf3f2-14d9-4dc7-b1eb-8ba0de0963c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 38185 microversion: 2.20 time: 0.077785 Jan 28 08:14:09.890772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 548/1081] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:09 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 38185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:14:10.888509 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:10.889507 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:10.896334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:10.896774 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:10.897616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:10.898051 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:10.902489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:10.903503 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:10.911226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:10.911694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:10.912621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:10.912892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:10.968708 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0499e2ed-6dc1-41ba-b915-73ac4c83a5e3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.083970 Jan 28 08:14:10.969397 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 534/1082] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:10 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:10.984048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-09e05ba2-113c-4b37-98a6-8d7ae64cfd43 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 200 len: 38326 microversion: 2.20 time: 0.085368 Jan 28 08:14:10.984720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 549/1083] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:10 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 38326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:14:10.997926 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:10.998510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:11.005421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:11.005915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:11.006696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:11.007132 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:11.031291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-000268dc-1812-41d5-83ce-09e10a52b8d3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/ips" status: 200 len: 151 microversion: 2.20 time: 0.037450 Jan 28 08:14:11.031864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 535/1084] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jan 28 08:14:10 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:11.984300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:11.985291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:11.992647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:11.993102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:11.993883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:11.994326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:12.054523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5c9ab0db-88d9-4b1b-ac59-cecdaece1dba tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28199 microversion: 2.1 time: 0.074201 Jan 28 08:14:12.055484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 550/1085] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:11 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:13.066381 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:13.074537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:13.074537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:13.074537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:13.074954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:13.075427 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:13.146971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b5ed0b97-e4f4-43ce-bda3-7d247cc085f4 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28490 microversion: 2.1 time: 0.084679 Jan 28 08:14:13.147556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 536/1086] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:13 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28490 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:13.470220 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:13.475335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:13.477527 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:13.477984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:13.478756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:13.479193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:13.502641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lazy-loading 'flavor' on Instance uuid 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:14:14.157551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-56e817d5-20d9-405c-acf1-2a6ff86ead91 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 202 len: 0 microversion: 2.20 time: 0.691170 Jan 28 08:14:14.158551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 551/1087] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:13 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:14:14.163196 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:14.164309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:14.172295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:14.172752 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:14.172938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:14.173550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:14.173657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:14.173994 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:14.180303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:14.182707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:14.182707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:14.182707 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:14.252074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2bc185d4-591a-4c96-8bc1-8feea36384c6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28543 microversion: 2.1 time: 0.097234 Jan 28 08:14:14.252743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 537/1088] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:14 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28543 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:14.312973 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:14.320856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:14.322369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:14.323580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-61403877-737a-4eea-af4e-4e9bdc071c8e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.154730 Jan 28 08:14:14.324089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 552/1089] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:14 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:15.264743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:15.265724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:15.273095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:15.273577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:15.274361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:15.274802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:15.341634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:15.342283 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:15.348581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:15.349036 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:15.349964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:15.350401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:15.353512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-835ddd9e-aa2d-4917-9748-49f0913b2222 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.092687 Jan 28 08:14:15.354410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 538/1090] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:15 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:15.475368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:15.483126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:15.484686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:15.485830 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c0f644e7-d26c-4c54-8b82-25744cc489e8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.147889 Jan 28 08:14:15.486400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 553/1091] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:15 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:16.366349 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:16.367400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:16.374207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:16.374666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:16.375480 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:16.375923 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:16.436907 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d4a5726f-a07b-4497-a315-b55162a2ac96 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.075155 Jan 28 08:14:16.437547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 539/1092] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:16 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:16.503979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:16.504590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:16.510841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:16.511321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:16.512098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:16.512537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:16.637022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:16.645161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:16.646669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:16.647860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-65256000-6066-4d77-8f83-e73b58b9186b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.147618 Jan 28 08:14:16.648427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 554/1093] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:16 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:17.449417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:17.450414 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:17.457344 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:17.457794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:17.458567 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:17.459003 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:17.521978 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f4570f9d-1d3e-45a1-adc1-b0a5b54c26f3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.076409 Jan 28 08:14:17.525939 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 540/1094] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:17 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:17.665978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:17.666516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:17.674248 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:17.677618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:17.677618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:17.677618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:17.808687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:17.816410 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:17.817917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:17.819053 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d602f3a7-da34-463c-851d-f3c63047654f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.156943 Jan 28 08:14:17.819631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 555/1095] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:17 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:18.534827 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:18.535864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:18.542713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:18.543168 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:18.544875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:18.544875 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:18.602254 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-736e5325-3be1-4732-b014-3768325ce9fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.072111 Jan 28 08:14:18.602806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 541/1096] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:18 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:18.836733 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:18.837345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:18.843555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:18.844004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:18.844772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:18.845205 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:18.972362 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:18.980921 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:18.982570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:18.983747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-77f2cdfb-24f0-4350-b930-b74aaced62b2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.150816 Jan 28 08:14:18.984526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 556/1097] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:18 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:19.614770 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:19.615806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:19.622736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:19.623198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:19.624007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:19.624447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:19.692202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a43e9c42-6a8d-4a08-b45f-7bf01491c322 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.081928 Jan 28 08:14:19.692817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 542/1098] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:19 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:20.002226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:20.002765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:20.009067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:20.009523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:20.010300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:20.010739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:20.343726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:20.351513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:20.353010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:20.354151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-408f51d7-1f23-435a-8688-d068a818c5af tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.355767 Jan 28 08:14:20.354698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 557/1099] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:19 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:20.704407 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:20.705329 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:20.712311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:20.713570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:20.713570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:20.713945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:20.789024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0ec34de4-cb05-4861-8a51-9f3186fcfdc3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.088722 Jan 28 08:14:20.789883 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 543/1100] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:20 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:21.373193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:21.373812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:21.380132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:21.380580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:21.381346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:21.381778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:21.504363 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:21.512046 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:21.513555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:21.514736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2964d4b4-b143-43d4-bd56-df345abd86b7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.145244 Jan 28 08:14:21.515345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 558/1101] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:21 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:21.801109 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:21.802119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:21.809169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:21.809621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:21.810408 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:21.810848 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:21.869271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cd641031-b2be-4329-ae0e-569c1403d458 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.072199 Jan 28 08:14:21.870139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 544/1102] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:21 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:22.532957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:22.533816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:22.540117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:22.540570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:22.541345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:22.541784 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:22.667696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:22.676063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:22.677601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:22.678754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-31010cac-0afb-44e7-bc14-197d5c868d7a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.149574 Jan 28 08:14:22.679342 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 559/1103] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:22 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:22.881496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:22.882533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:22.889514 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:22.889967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:22.890748 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:22.891191 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:22.950155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6600ac05-3091-4ef8-8801-18cc0b46cce2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.072798 Jan 28 08:14:22.950783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 545/1104] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:22 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:23.697063 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:23.698127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:23.704159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:23.704611 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:23.705424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:23.705856 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:23.832431 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:23.840485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:23.842003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:23.843159 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-98612e9c-c0bc-41cc-a99f-e4c776384cf5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.149845 Jan 28 08:14:23.843807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 560/1105] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:23 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:23.962636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:23.963657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:23.970406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:23.970851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:23.971641 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:23.972074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:24.030716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4739bea6-b755-4a49-bf1d-467cf7cac02f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.071934 Jan 28 08:14:24.031384 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 546/1106] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:23 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:24.861762 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:24.862368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:24.868663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:24.869106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:24.869867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:24.870298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:24.992004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:24.999586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:25.001086 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:25.002216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c2f4405f-34ed-4d6e-9461-fd7229fc858f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.144174 Jan 28 08:14:25.002769 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 561/1107] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:24 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:25.044185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:25.045194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:25.052086 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:25.052542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:25.053320 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:25.053759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:25.556349 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-86febd93-91d6-4a84-b1f5-c4fe8fdeedfb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.516168 Jan 28 08:14:25.557246 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 547/1108] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:25 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:26.019849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:26.020393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:26.027231 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:26.029043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:26.029043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:26.029043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:26.157579 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:26.166010 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:26.168489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:26.168722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f8ffdb4c-3a0c-493c-bcee-e90e0a8336dc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.152611 Jan 28 08:14:26.169273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 562/1109] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:26 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:26.568382 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:26.569372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:26.576189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:26.576580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:26.577341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:26.577773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:26.636623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0bde31bb-2d50-436e-8672-6e654a8f9cf5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.072199 Jan 28 08:14:26.637494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 548/1110] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:26 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:27.187619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:27.188251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:27.194427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:27.194874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:27.195693 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:27.196131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:27.320288 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:27.328168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:27.329701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:27.330839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-199f050a-8ca2-4333-b039-efcb156217d1 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.146976 Jan 28 08:14:27.331444 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 563/1111] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:27 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:27.648917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:27.649909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:27.656686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:27.657154 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:27.657904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:27.658600 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:27.723210 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b2b94b21-986b-471c-bff8-52a1397ff304 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.078689 Jan 28 08:14:27.724094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 549/1112] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:27 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:28.349978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:28.350582 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:28.356795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:28.358850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:28.358850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:28.358850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:28.490829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:28.498473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:28.500007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:28.501147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d48e5706-cb48-43bd-81f5-e837b7c9cae8 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.155507 Jan 28 08:14:28.501708 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 564/1113] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:28 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:28.735064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:28.736033 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:28.745047 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:28.745739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:28.747109 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:28.747946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:28.818790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4f391693-bfde-40f6-be6b-2f47ee576b32 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.087622 Jan 28 08:14:28.819733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 550/1114] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:28 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:29.518315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:29.518848 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:29.525127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:29.525580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:29.526354 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:29.526789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:29.573162 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-026d6dac-1867-4d8e-99d6-28fa774950f5 req-31dd073c-113a-4a7b-afc9-b8e7f3118647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "name": "network-vif-plugged", "status": "completed", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:29.575219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:14:29.575219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:14:29.583464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-026d6dac-1867-4d8e-99d6-28fa774950f5 req-31dd073c-113a-4a7b-afc9-b8e7f3118647 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:29.583989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-026d6dac-1867-4d8e-99d6-28fa774950f5 req-31dd073c-113a-4a7b-afc9-b8e7f3118647 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:29.594938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-026d6dac-1867-4d8e-99d6-28fa774950f5 req-31dd073c-113a-4a7b-afc9-b8e7f3118647 service nova] Creating event network-vif-plugged:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:14:29.600309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-026d6dac-1867-4d8e-99d6-28fa774950f5 req-31dd073c-113a-4a7b-afc9-b8e7f3118647 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031508 Jan 28 08:14:29.600913 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 551/1115] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:14:29.653738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:29.662389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:29.667019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:29.667019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a989796e-ade8-4593-85c9-6127fc791f2e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.150681 Jan 28 08:14:29.667019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 565/1116] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:29 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:29.830841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:29.832515 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:29.838645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:29.839101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:29.840039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:29.840477 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:29.914890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-04824fd2-3cbb-4202-88d6-90bee9f79ff8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.088430 Jan 28 08:14:29.915553 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 552/1117] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:29 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:30.683030 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:30.683622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:30.689872 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:30.690323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:30.691141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:30.691605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:30.816566 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:30.824192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:30.825717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:30.826859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6e86d4cb-91e8-4b8f-828a-050ea272d691 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.147635 Jan 28 08:14:30.827436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 566/1118] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:30 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:30.926708 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:30.927727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:30.934484 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:30.934868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:30.935668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:30.936100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:30.996197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-eca49da0-8847-4bd9-bd18-58d0babfaaa5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.073471 Jan 28 08:14:30.996840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 553/1119] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:30 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:31.845531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:31.846147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:31.852737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:31.853199 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:31.853986 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:31.854428 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:31.986206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:31.994002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:31.995557 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:31.996724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cf230912-6579-47a9-9355-9917f51d1877 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1743 microversion: 2.20 time: 0.155132 Jan 28 08:14:31.997270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 567/1120] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:31 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:32.008575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:32.009575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:32.016078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:32.016531 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:32.017308 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:32.017748 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:32.082745 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a5059cc1-5d53-467e-b1e7-45115df0217a tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.077264 Jan 28 08:14:32.083380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 554/1121] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:32 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:33.017937 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:33.019346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:33.028643 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:33.029654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:33.030725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:33.031407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:33.094706 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:33.096754 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:33.104630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:33.105362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:33.106171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:33.106763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:33.184090 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-695d07da-cea1-45d6-83d5-6f311b6092ed tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.093501 Jan 28 08:14:33.184895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:33.187957 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 555/1122] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:33 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:33.196619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:33.199222 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:33.201242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e22edaec-0a4c-473c-b624-d4fe32a958e6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.188657 Jan 28 08:14:33.202027 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 568/1123] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:33 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:33.912092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:14:33.912557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:14:34.198862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:34.200228 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:34.208349 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:34.209101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:34.210158 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:34.210551 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:34.220868 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:34.225589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:34.228565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:34.229305 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:34.230173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:34.230800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:34.281348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-467e96dc-0c4d-48c5-8441-2d33a55c58ca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.086445 Jan 28 08:14:34.282608 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 556/1124] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:34 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:34.368216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:34.376292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:34.377791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:34.379002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d53725a5-1d7a-4914-a59f-6650feadb09d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.162443 Jan 28 08:14:34.380043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 569/1125] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:34 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:35.294589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:35.295656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:35.304171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:35.304812 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:35.305496 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:35.305945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:35.392960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0747c8a1-c99b-48b0-a17b-5c3468e7f2f9 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.101359 Jan 28 08:14:35.393400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 557/1126] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:35 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:35.400100 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:35.400637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:35.407765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:35.408484 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:35.409307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:35.409748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:35.547537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:35.555296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:35.556950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:35.558099 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c858793c-6c52-4548-8494-b62c94fb1186 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.162673 Jan 28 08:14:35.558667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 570/1127] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:35 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:36.404222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:36.405236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:36.412889 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:36.413353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:36.414143 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:36.414583 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:36.493172 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4b8c41d7-a814-4d8f-b0cc-b2eb992ee5c0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.092790 Jan 28 08:14:36.495291 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 558/1128] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:36 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:36.576497 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:36.577789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:36.585479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:36.586207 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:36.587386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:36.587703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:36.725372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:36.733935 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:36.735488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:36.736843 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0466d9e7-6522-4878-b78d-de2cc1f12de7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.164216 Jan 28 08:14:36.737890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 571/1129] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:36 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:37.506874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:37.508555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:37.515771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:37.516498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:37.517530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:37.517912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:37.585777 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-88654a02-bad3-4da9-9b35-42fba103d2d2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.082978 Jan 28 08:14:37.587679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 559/1130] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:37 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:37.756405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:37.757125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:37.764019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:37.764737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:37.765759 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:37.766262 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:37.917797 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:37.925880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:37.928236 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:37.929380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-babf5b27-ca72-420b-ace6-766ac06c9d55 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.177292 Jan 28 08:14:37.940826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 572/1131] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:37 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:38.602630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:38.603767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:38.611128 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:38.611676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:38.612568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:38.613101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:38.678226 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9ec71b46-9f92-471c-882e-6b98cbdebaf2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.080610 Jan 28 08:14:38.678865 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 560/1132] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:38 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:38.946629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:38.947171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:38.953726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:38.954174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:38.954945 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:38.955437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:39.086242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:39.093980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:39.095532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:39.096682 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cf6b5693-1df4-464d-9bd7-1ddb6066eeab tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.153909 Jan 28 08:14:39.097234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 573/1133] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:38 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:39.690990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:39.692092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:39.702769 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:39.703218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:39.704061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:39.704503 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:39.786399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d1ae4856-f6ed-485d-9c88-f238a074b91f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.099174 Jan 28 08:14:39.787486 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 561/1134] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:39 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:40.145555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:40.146927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:40.154004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:40.154748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:40.155624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:40.156008 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:40.316496 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:40.327171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:40.330599 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:40.331802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4e386e90-ec63-407e-8eea-72cb12505169 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.190078 Jan 28 08:14:40.333119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 574/1135] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:40 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:40.798500 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:40.799520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:40.808101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:40.808622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:40.809427 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:40.809873 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:40.874289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9c747721-5f16-49e5-a7d9-ec9ed10360fb tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.079632 Jan 28 08:14:40.875007 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 562/1136] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:40 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:41.350827 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:41.351756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:41.358269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:41.358809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:41.359636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:41.360075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:41.500155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:41.508388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:41.510043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:41.511401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f2d9ff5b-5379-4a8d-95e4-86ccdc8c7645 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.164876 Jan 28 08:14:41.522062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 575/1137] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:41 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:41.890411 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:41.891502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:41.898541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:41.899092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:41.899954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:41.900402 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:41.961929 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-06c1b5e3-7f7a-48b7-b76b-3c6d71070c49 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.075574 Jan 28 08:14:41.963156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 563/1138] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:41 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:42.131795 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:14:42.132027 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:14:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:14:42.529772 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:42.530413 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:42.537897 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:42.538359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:42.539139 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:42.539598 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:42.694335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:42.702740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:42.705787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:42.705787 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-242306c3-7e76-4c89-a8d0-947e5837a6c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.179662 Jan 28 08:14:42.715583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 576/1139] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:42 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:42.975118 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:42.976147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:42.984845 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:42.985380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:42.986273 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:42.986743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:43.056757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6e853e2e-2bac-405a-a8d1-a8425e8c3c02 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.086277 Jan 28 08:14:43.057420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 564/1140] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:42 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:43.724902 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:43.725546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:43.731853 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:43.732311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:43.733096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:43.733539 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:43.860984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:43.868841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:43.870644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:43.871541 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5c2c7606-4899-49b3-836d-246bad47e851 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1738 microversion: 2.20 time: 0.150923 Jan 28 08:14:43.872105 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 577/1141] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:43 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:44.069240 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:44.073362 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:44.077336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:44.077788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:44.078575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:44.079032 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:44.141670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d218d204-91f6-4f1a-9179-5ed70908de57 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 28658 microversion: 2.1 time: 0.076780 Jan 28 08:14:44.142350 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 565/1142] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:44 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 28658 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:44.889862 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:44.890398 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:44.897140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:44.897594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:44.898372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:44.898812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:45.020783 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:45.028535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:45.030050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:45.031196 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dcbe5ef9-f60f-434c-8af7-b502a5c9f7eb tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1720 microversion: 2.20 time: 0.145139 Jan 28 08:14:45.031782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 578/1143] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:44 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:45.156018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:45.157926 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:45.166613 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:45.167466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:45.168850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:45.169660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:45.245866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-631b35e0-01b2-4e44-804b-ee60df5cee75 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 29635 microversion: 2.1 time: 0.096014 Jan 28 08:14:45.246798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 566/1144] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:45 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 29635 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:46.049629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:46.050242 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:46.056532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:46.056981 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:46.057749 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:46.058186 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:46.185123 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:46.193276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:46.194786 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:46.195963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1af6a2f6-d78a-4f3a-9911-e45b4ef2b627 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1720 microversion: 2.20 time: 0.150078 Jan 28 08:14:46.196514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 579/1145] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:46 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:46.258376 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:46.259348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:46.266229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:46.266684 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:46.267495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:46.267934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:46.353692 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ce62d771-2660-4367-8d17-3a90abd319b0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 31581 microversion: 2.1 time: 0.099733 Jan 28 08:14:46.354386 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 567/1146] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:46 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 31581 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:47.214062 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:47.214667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:47.221051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.221500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.222274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.222755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.349271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:47.357042 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:47.358559 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:47.359732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-caf25aea-839c-4730-9285-32b581efabfc tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1663 microversion: 2.20 time: 0.149494 Jan 28 08:14:47.360452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 580/1147] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:47 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:47.366277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:47.367306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:47.374176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.374633 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.375451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.375947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.382755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a9c9a4b-2e6a-4266-9a5a-2c9dceba44af"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:47.382755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:47.384717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.385176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.385949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.386383 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.446968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a1b9dd50-9e18-4863-8ecc-29d97b951cb5 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 33209 microversion: 2.1 time: 0.085059 Jan 28 08:14:47.451049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 568/1148] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:47 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 33209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:47.594108 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-7f01149b-72d2-4b5a-aff9-d2d2b4206f3b req-495fc89d-a1bc-45ff-8155-184b7eff51b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "name": "network-vif-unplugged", "status": "completed", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:47.595648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:14:47.595648 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:14:47.603909 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7f01149b-72d2-4b5a-aff9-d2d2b4206f3b req-495fc89d-a1bc-45ff-8155-184b7eff51b1 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:47.604358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-7f01149b-72d2-4b5a-aff9-d2d2b4206f3b req-495fc89d-a1bc-45ff-8155-184b7eff51b1 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:47.615474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.compute.server_external_events [req-7f01149b-72d2-4b5a-aff9-d2d2b4206f3b req-495fc89d-a1bc-45ff-8155-184b7eff51b1 service nova] Unable to find a host for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99. Dropping event network-vif-unplugged {{(pid=116948) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 08:14:47.616334 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-7f01149b-72d2-4b5a-aff9-d2d2b4206f3b req-495fc89d-a1bc-45ff-8155-184b7eff51b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026381 Jan 28 08:14:47.616904 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 569/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 28 08:14:48.457947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:48.459005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:48.465236 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:48.465690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:48.466497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:48.466944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:48.499863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ab1f996f-9bbb-4003-ad66-ebe0e35da81c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.126231 Jan 28 08:14:48.500481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 581/1150] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jan 28 08:14:47 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments => generated 188 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:48.535731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bce94e66-8331-4561-b0f3-762340cfba98 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 34187 microversion: 2.1 time: 0.080899 Jan 28 08:14:48.539880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 570/1151] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:48 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 34187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:48.606578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:48.607082 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:48.614257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:48.614710 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:48.615522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:48.615965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.156161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fa1430c9-6db8-4c5c-887b-913c92f30806 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments/1a9c9a4b-2e6a-4266-9a5a-2c9dceba44af" status: 202 len: 0 microversion: 2.20 time: 0.553241 Jan 28 08:14:49.156672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 582/1152] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jan 28 08:14:48 2022] DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments/1a9c9a4b-2e6a-4266-9a5a-2c9dceba44af => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:14:49.216698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:49.217361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:49.224229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.224677 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.225860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.226645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.519614 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1038ee94-aa5b-4a94-a314-07d113fa748c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action" status: 202 len: 0 microversion: 2.20 time: 0.306872 Jan 28 08:14:49.520219 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 571/1153] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jan 28 08:14:49 2022] POST /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:14:49.528095 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:49.529236 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:49.535836 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.536280 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.537048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.537515 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.547491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:49.548466 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:49.555940 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.557158 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.557337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:49.557663 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:49.630454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1b98e34a-411d-49e8-8ad9-3270e9925d1d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 35380 microversion: 2.1 time: 0.086504 Jan 28 08:14:49.634968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 572/1154] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:49 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 35380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 08:14:49.676562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:49.684368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:49.686740 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:49.687122 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1e97c67e-3f9b-43f9-a2f9-4b21e4e5fab6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1671 microversion: 2.20 time: 0.162743 Jan 28 08:14:49.687721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 583/1155] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:49 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:50.642628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:50.643668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:50.651268 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:50.651734 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:50.652528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:50.652968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:50.705802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:50.706396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:50.713192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:50.713636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:50.714430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:50.714859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:50.729893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9ed8d6ca-576e-46ef-98e1-f36937744a65 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 36863 microversion: 2.1 time: 0.091365 Jan 28 08:14:50.731023 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 573/1156] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:50 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 36863 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:50.841331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:50.848977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:50.850479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:50.851636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6bf33662-5bd5-44bc-bcbf-564a6c5fcf1d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1671 microversion: 2.20 time: 0.149636 Jan 28 08:14:50.856001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 584/1157] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:50 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:51.742131 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:51.743170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:51.750063 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:51.750520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:51.751323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:51.751768 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:51.822032 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a563dd1b-d830-42eb-bebe-b94aa6896929 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 38193 microversion: 2.1 time: 0.083761 Jan 28 08:14:51.822941 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 574/1158] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:51 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 38193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:14:51.870438 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:51.871051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:51.877388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:51.877835 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:51.878601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:51.879640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:52.009545 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:52.017381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:52.018901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:52.020113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8e42e695-e3fa-4304-9acf-084a9c751e7c tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.153566 Jan 28 08:14:52.020675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 585/1159] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:51 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:14:52.835296 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:14:52.836905 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:52.843975 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:52.844421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:52.845204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:52.845636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:53.038694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:53.039332 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:53.045531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:53.045983 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:53.046750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:53.047187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:53.185132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:53.193474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:53.195394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:53.196944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-96b2753f-bd15-46d7-beca-47c33880fab3 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.161994 Jan 28 08:14:53.197543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 586/1160] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:53 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:54.216133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:54.216927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:54.224758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:54.225501 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:54.226307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:54.226752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:54.368424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:54.376204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:54.377689 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:54.378943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-536fd7cc-8a8e-4ebf-9aa9-e12cfeedb6ac tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.167363 Jan 28 08:14:54.379739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 587/1161] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:54 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:55.397390 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:55.398107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:55.406933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:55.407724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:55.408533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:55.408972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:55.570978 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:55.580249 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:55.582246 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:55.583450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4c793eba-af7b-4af1-b391-6c9ee1635ad7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.190267 Jan 28 08:14:55.584011 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 588/1162] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:55 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:56.602706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:56.603823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:56.611223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:56.612021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:56.613712 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:56.614603 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:56.745960 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:56.754552 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:56.756165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:56.757334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e33ba91e-f54a-49c4-9f60-bc9605bf47d7 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.159072 Jan 28 08:14:56.758273 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 589/1163] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:56 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:57.775387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:57.776270 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:57.783767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:57.784253 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:57.785028 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:57.785462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:57.923953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:57.932775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:57.934456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:57.935742 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bf63b9b5-7cd3-4168-8e6b-9603c37c4523 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.164155 Jan 28 08:14:57.936379 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 590/1164] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:57 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:14:58.955806 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:14:58.956526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:14:58.964374 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:58.965003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:58.966065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:14:58.966630 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:14:59.097461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:59.105702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:59.107233 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:14:59.108434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a610f79d-ad16-412a-b273-818a197305c2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.156823 Jan 28 08:14:59.111677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 591/1165] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:14:58 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:00.126857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:00.127589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:00.133789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:00.134229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:00.135001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:00.135472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:00.273984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:00.281975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:00.283849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:00.285005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1ffe6826-1f11-4f7c-bd8e-f5804b2f3efd tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.161855 Jan 28 08:15:00.285573 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 592/1166] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:00 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:01.304509 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:01.310452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:01.312126 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:01.312590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:01.313381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:01.313815 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:01.449883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:01.456966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:01.458565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:01.459764 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e25d81ef-a229-48a0-929e-7a7b27b5741a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.159666 Jan 28 08:15:01.460522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 593/1167] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:01 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:02.479292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:02.479982 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:02.486618 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:02.487066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:02.488443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:02.488878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:02.618110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:02.625816 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:02.627479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:02.629150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-972c58e9-648d-41e3-8e67-c54dd7ea24ad tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.153642 Jan 28 08:15:02.629715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 594/1168] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:02 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:03.648133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:03.648770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:03.654866 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:03.655355 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:03.656137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:03.656576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:03.785113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:03.792938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:03.794459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:03.795632 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e00e229d-641f-46d9-93fb-d9ce9adfd060 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.151907 Jan 28 08:15:03.796198 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 595/1169] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:03 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:04.476765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-84a7d28b-fc97-497f-844b-f7bfa0e98049 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action" status: 200 len: 38324 microversion: 2.1 time: 11.646054 Jan 28 08:15:04.477719 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 575/1170] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:14:52 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/action => generated 38324 bytes in 11648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 08:15:04.486984 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:04.487533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:04.494359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:04.494809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:04.495803 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:04.501137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:04.519662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ca332ab9-8eef-43a5-b41a-dd3d84ff4bca tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/ips" status: 200 len: 144 microversion: 2.1 time: 0.036321 Jan 28 08:15:04.524044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 596/1171] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:15:04 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:04.814141 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:04.814866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:04.821639 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:04.822092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:04.822856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:04.823306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:04.950958 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:04.959222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:04.960815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:04.961950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-baf1dbdd-9131-4f2c-83e3-707f7bde49c5 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.151879 Jan 28 08:15:04.962519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 576/1172] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:04 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 08:15:05.980841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:05.981418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:05.987748 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:05.988693 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:05.989478 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:05.989919 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:06.116936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:06.118975 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "693f202f-51f9-4f83-9891-48bbaef19a32"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:15:06.120077 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:06.124769 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:06.126264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:06.126401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:06.126794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:06.127479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-16acece2-6ce0-42b0-b63f-b5597c96ebbf tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.150394 Jan 28 08:15:06.134271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:06.134271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:06.134510 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 597/1173] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:05 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:07.150791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:07.151504 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:07.158240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:07.158692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:07.159540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:07.160447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:07.293754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:07.301549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:07.303058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:07.304236 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0a7748d4-f444-4780-a21c-d6cfd3da611d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.157250 Jan 28 08:15:07.304790 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 598/1174] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:07 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:07.618819 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd1333ce-325c-4e9d-9d2d-305a610c8891 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.503469 Jan 28 08:15:07.619457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 577/1175] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:15:06 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 194 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:08.325353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:08.325980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:08.332461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:08.332913 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:08.333696 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:08.334133 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:08.459358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:08.467120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:08.468667 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:08.469809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9b5477b6-d5a0-4647-9c5c-e07497930f1e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.151845 Jan 28 08:15:08.470371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 599/1176] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:08 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:09.490394 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:09.491034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:09.498497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:09.498948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:09.499764 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:09.500204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:09.633443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:09.641146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:09.642647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:09.643852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-19d92e95-19d8-44c5-8f77-769c08c53ae2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.158327 Jan 28 08:15:09.645417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 578/1177] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:09 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:09.761120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-3658f324-3f7d-4bd2-a3c5-5c23e96c2bbe req-72b2a479-c49c-4cd8-bce6-cb3200b3815e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "name": "network-vif-plugged", "status": "completed", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:15:09.762949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:15:09.762949 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:15:09.770522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3658f324-3f7d-4bd2-a3c5-5c23e96c2bbe req-72b2a479-c49c-4cd8-bce6-cb3200b3815e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:09.770975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3658f324-3f7d-4bd2-a3c5-5c23e96c2bbe req-72b2a479-c49c-4cd8-bce6-cb3200b3815e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:09.781480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-3658f324-3f7d-4bd2-a3c5-5c23e96c2bbe req-72b2a479-c49c-4cd8-bce6-cb3200b3815e service nova] Creating event network-vif-plugged:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:15:09.821614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-3658f324-3f7d-4bd2-a3c5-5c23e96c2bbe req-72b2a479-c49c-4cd8-bce6-cb3200b3815e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029917 Jan 28 08:15:09.821614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 600/1178] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:10.663121 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:10.663755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:10.670093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:10.670543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:10.671336 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:10.671788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:10.798689 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:10.807032 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:10.808559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:10.809702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-18c4ff29-1406-4c2e-8017-39a570851a3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.150922 Jan 28 08:15:10.810261 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 579/1179] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:10 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:11.829388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:11.830078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:11.836817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:11.837214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:11.838001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:11.838439 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:11.968067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:11.975860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:11.977368 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:11.983168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2c6fb297-3922-43d5-b789-7216e8ff3e7f tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1729 microversion: 2.20 time: 0.153899 Jan 28 08:15:11.983168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 601/1180] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:11 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:12.996954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:12.997590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:13.004457 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:13.004901 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:13.005697 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:13.006123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:13.130691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:13.138329 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:13.139856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:13.140992 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2a931c2e-a3c9-4fe7-8304-640ebf971d3a tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1716 microversion: 2.20 time: 0.147772 Jan 28 08:15:13.141550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 580/1181] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:15:12 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:15:15.080480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:15.084943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:15.087791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:15.088243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:15.089014 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:15.089448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:15.117893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-60035786-184f-4160-ae9f-91050ecf6c59 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Jan 28 08:15:15.118435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 602/1182] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:15:15 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:15.127942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:15.128491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:15.135330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:15.135789 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:15.136577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:15.137018 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:15.164882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b6695dcf-5be3-494e-9175-072ea01cd482 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32" status: 200 len: 194 microversion: 2.1 time: 0.040740 Jan 28 08:15:15.165451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 581/1183] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jan 28 08:15:15 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:16.807322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bfef92b-78b3-417e-a3d6-fe75db091c22"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:15:16.808887 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:16.814499 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:16.815022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:16.815821 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:16.816744 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:17.523219 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-392e9849-14f7-432f-95d1-a27707701e31 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719386 Jan 28 08:15:17.523867 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 603/1184] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:15:16 2022] POST /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:24.977850 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:24.978813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:24.985114 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:24.985638 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:24.986426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:24.986856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:25.024212 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-51aa3a30-2661-4025-a461-b5b58f47aff3 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050040 Jan 28 08:15:25.089658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 582/1185] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:15:24 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:25.309789 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:25.310436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:25.316688 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:25.317140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:25.317955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:25.318396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:25.347558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b13bcb79-449f-479e-a9ae-10626a5f89a2 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32" status: 200 len: 194 microversion: 2.1 time: 0.042332 Jan 28 08:15:25.348817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 604/1186] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jan 28 08:15:25 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:25.358317 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:25.358821 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:25.364925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:25.367838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:25.367838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:25.367838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:25.442436 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lazy-loading 'services' on Instance uuid 3c4c3136-3f76-4a8e-94fd-ae717389411f {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:15:25.704575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2c153d9e-1b32-41e3-b349-03c019247c21 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32" status: 202 len: 0 microversion: 2.1 time: 0.349798 Jan 28 08:15:25.705209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 583/1187] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:15:25 2022] DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/693f202f-51f9-4f83-9891-48bbaef19a32 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:15:27.861944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:27.862444 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:27.869151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:27.869604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:27.870385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:27.870823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:27.899060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-efe24906-0259-4b91-b1a8-b4125b5a1d5f tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/4bfef92b-78b3-417e-a3d6-fe75db091c22" status: 200 len: 194 microversion: 2.1 time: 0.040878 Jan 28 08:15:27.899670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 605/1188] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jan 28 08:15:27 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/4bfef92b-78b3-417e-a3d6-fe75db091c22 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:27.910141 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:27.910824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:27.918375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:27.918833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:27.919643 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:27.920117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:27.997408 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lazy-loading 'services' on Instance uuid 3c4c3136-3f76-4a8e-94fd-ae717389411f {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:15:28.367270 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0e53ccdf-33b7-46c5-8efb-0175629726e6 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/4bfef92b-78b3-417e-a3d6-fe75db091c22" status: 202 len: 0 microversion: 2.1 time: 0.461687 Jan 28 08:15:28.367936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 584/1189] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:15:27 2022] DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments/4bfef92b-78b3-417e-a3d6-fe75db091c22 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:15:29.523543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:29.524463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:29.530605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.531058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.532153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.532593 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.561967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cf45e972-1bfa-4a0c-864d-99c59f68c8c8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042105 Jan 28 08:15:29.562518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 606/1190] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:15:29 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:15:29.666944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:29.668019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:29.674011 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.674454 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.675218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.675671 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.704449 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5447fc93-c13d-4701-b236-6d7569172b72 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042014 Jan 28 08:15:29.704921 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 585/1191] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:15:29 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:15:29.758001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:29.758499 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:29.764223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.764662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.765437 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:29.765875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:29.790022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:15:30.091129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a3b0a660-f256-405a-a19e-d5506c8a3449 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 204 len: 0 microversion: 2.1 time: 0.336418 Jan 28 08:15:30.091831 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 607/1192] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:15:29 2022] DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:15:30.100135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:30.100744 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:30.106541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:30.106994 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:30.107805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:30.108242 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:30.233377 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:30.240635 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-7577decd-9d31-4bde-92c3-8bf7df189120 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1672 microversion: 2.1 time: 0.144727 Jan 28 08:15:30.241204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 586/1193] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:30 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:15:31.258338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:31.259105 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:31.265449 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:31.265906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:31.266691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:31.267130 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:31.411066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:31.418621 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4f35b548-100c-4547-99aa-cd53215455c7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1672 microversion: 2.1 time: 0.164456 Jan 28 08:15:31.419192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 608/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:31 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:15:32.450010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:32.450010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:32.450010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:32.450010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:32.450924 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:32.450924 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:32.865244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:32.872915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ddb9d0e6-8a11-4cae-b807-dd6965b553a8 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1672 microversion: 2.1 time: 0.441158 Jan 28 08:15:32.873494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 587/1195] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:32 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1672 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:15:33.356055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-508a4415-d2a3-4e65-8710-3c4babeff853 req-58ebac47-0e2d-47b0-917c-b2b8cf34ffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4c3136-3f76-4a8e-94fd-ae717389411f", "name": "network-vif-deleted", "tag": "f634e38e-0b18-4dac-88a9-1f25244d0fe3"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:15:33.360813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:15:33.360813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:15:33.366279 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-508a4415-d2a3-4e65-8710-3c4babeff853 req-58ebac47-0e2d-47b0-917c-b2b8cf34ffeb service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:33.366746 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-508a4415-d2a3-4e65-8710-3c4babeff853 req-58ebac47-0e2d-47b0-917c-b2b8cf34ffeb service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:33.378381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-508a4415-d2a3-4e65-8710-3c4babeff853 req-58ebac47-0e2d-47b0-917c-b2b8cf34ffeb service nova] Creating event network-vif-deleted:f634e38e-0b18-4dac-88a9-1f25244d0fe3 for instance 3c4c3136-3f76-4a8e-94fd-ae717389411f on hv-cinder-80403 Jan 28 08:15:33.383225 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-508a4415-d2a3-4e65-8710-3c4babeff853 req-58ebac47-0e2d-47b0-917c-b2b8cf34ffeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035006 Jan 28 08:15:33.383849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 609/1196] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:15:33.889841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:33.890463 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:33.897245 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:33.897707 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:33.898498 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:33.898935 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:33.903790 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:15:33.904436 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:15:33.935763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:33.936240 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:33.936881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lazy-loading 'fault' on Instance uuid 3c4c3136-3f76-4a8e-94fd-ae717389411f {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:15:33.987910 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f93eeb1fc477abcca365e18da11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff87d44e98bd466eabc90ba36bc969c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:15:33.998171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c498072d-63b1-48ca-95d9-bc96a6dad7b7 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 200 len: 1328 microversion: 2.1 time: 0.112028 Jan 28 08:15:33.999101 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 588/1197] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:33 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:15:35.016711 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:35.017419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:35.025959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:35.026420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:35.027202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:35.027665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:35.040489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. Jan 28 08:15:35.041075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:15:35.041886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f18ca852-6c3a-4201-9867-2e28b91ec78d tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 404 len: 111 microversion: 2.1 time: 0.029716 Jan 28 08:15:35.042405 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 610/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:35 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:15:35.050541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c364c6cc-dc3e-4b38-bd7d-38a27f448e41 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '.version_select at 0x7f346f751550>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:35.142971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c364c6cc-dc3e-4b38-bd7d-38a27f448e41 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584894007" status: 202 len: 0 microversion: 2.1 time: 0.096112 Jan 28 08:15:35.143584 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 589/1199] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jan 28 08:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584894007 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:15:38.427370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:38.427969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:38.434240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:38.441846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:38.441846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:38.441846 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:38.449342 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. Jan 28 08:15:38.449941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:15:38.450736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f0350b72-5eb0-412f-a0a2-43acaa247ad0 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 404 len: 111 microversion: 2.1 time: 0.027154 Jan 28 08:15:38.451446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 611/1200] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:15:38 2022] DELETE /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:15:38.459504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:38.460159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 3c4c3136-3f76-4a8e-94fd-ae717389411f] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:38.466493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:38.466946 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:38.467759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:38.468209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:38.481129 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. Jan 28 08:15:38.481712 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 3c4c3136-3f76-4a8e-94fd-ae717389411f could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:15:38.482550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8584419b-a1c8-4e6c-b442-d17c06bbc623 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f" status: 404 len: 111 microversion: 2.1 time: 0.027384 Jan 28 08:15:38.484556 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 590/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:38 2022] GET /compute/v2.1/servers/3c4c3136-3f76-4a8e-94fd-ae717389411f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:15:39.765041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:39.765546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:39.772329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:39.772770 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:39.773532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:39.773957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:39.787687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. Jan 28 08:15:39.788306 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:15:39.812962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8f01fbf1-4848-486b-a40f-fafbd35bfb46 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 404 len: 111 microversion: 2.1 time: 0.027812 Jan 28 08:15:39.812962 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 612/1202] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:15:39 2022] DELETE /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:15:39.819460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:15:39.820088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] [instance: 7ab426f8-a759-4d28-b87b-c5a029df5761] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:15:39.826332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:39.826788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:39.827595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:15:39.828036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:15:39.841504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] HTTP exception thrown: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. Jan 28 08:15:39.842085 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] Returning 404 to user: Instance 7ab426f8-a759-4d28-b87b-c5a029df5761 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:15:39.842886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-34e2a6b5-1288-47ad-a998-6e78a286ad11 tempest-AttachVolumeTestJSON-642130027 tempest-AttachVolumeTestJSON-642130027-project] 10.222.0.42 "GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761" status: 404 len: 111 microversion: 2.1 time: 0.027174 Jan 28 08:15:39.843435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 591/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:15:39 2022] GET /compute/v2.1/servers/7ab426f8-a759-4d28-b87b-c5a029df5761 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:16:09.968734 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:09.969636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:09.975624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:09.976078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:09.976850 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:09.977286 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:10.008828 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6ef7e71a-ab24-4e74-ab8d-98f7e42ff7f0 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043891 Jan 28 08:16:10.009386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 613/1204] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jan 28 08:16:09 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:16:10.062751 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:10.063265 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:10.069746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:10.070197 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:10.070966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:10.071447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:10.095528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:16:10.521596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5b3bc21a-5f83-4167-9e4f-2c3d3587613b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 204 len: 0 microversion: 2.20 time: 0.462195 Jan 28 08:16:10.522194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 592/1205] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jan 28 08:16:10 2022] DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 08:16:10.530336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:10.530950 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:10.536932 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:10.537381 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:10.538151 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:10.538592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:10.816351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:10.824067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:10.825588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:10.826723 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-993cd94f-3b2a-47f1-b780-fa6c4224a7d4 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.300351 Jan 28 08:16:10.827302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 614/1206] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:10 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:11.689745 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:16:11.690394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:16:11.845017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:11.845717 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:11.852072 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:11.852525 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:11.853298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:11.853774 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:12.036171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:12.044407 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:12.045923 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:12.047080 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-11b967cb-2438-4079-ad62-b573461e0c11 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1722 microversion: 2.20 time: 0.206201 Jan 28 08:16:12.047694 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 593/1207] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:11 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:13.066004 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:13.066686 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:13.072976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:13.073420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:13.074188 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:13.074634 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:13.146953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:13.155795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:13.157330 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:13.158637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6c7d1eea-a63c-4653-865a-6068f9accc02 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1655 microversion: 2.20 time: 0.096532 Jan 28 08:16:13.159202 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 615/1208] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:13 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:13.264900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-eed972c5-fd77-47c4-888c-4b58df1f6417 req-e8aed33f-01e9-4154-8e7d-1b50903c6917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08514332-3c4b-4cb7-a4fc-6fd6f733fc99", "name": "network-vif-deleted", "tag": "46fe6592-286e-481b-a2ba-740aa1263ae0"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:16:13.264900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:16:13.264900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:16:13.266831 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-eed972c5-fd77-47c4-888c-4b58df1f6417 req-e8aed33f-01e9-4154-8e7d-1b50903c6917 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:13.267494 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-eed972c5-fd77-47c4-888c-4b58df1f6417 req-e8aed33f-01e9-4154-8e7d-1b50903c6917 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:13.279790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-eed972c5-fd77-47c4-888c-4b58df1f6417 req-e8aed33f-01e9-4154-8e7d-1b50903c6917 service nova] Creating event network-vif-deleted:46fe6592-286e-481b-a2ba-740aa1263ae0 for instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 on hv-cinder-80403 Jan 28 08:16:13.285944 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-eed972c5-fd77-47c4-888c-4b58df1f6417 req-e8aed33f-01e9-4154-8e7d-1b50903c6917 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 Jan 28 08:16:13.286550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 594/1209] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:14.178420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:14.179048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:14.186248 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:14.186706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:14.187522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:14.187958 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:14.248550 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:14.257513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:14.259742 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:14.260870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bd2629ab-f7b7-445f-b320-4b57221a5e3d tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1655 microversion: 2.20 time: 0.086546 Jan 28 08:16:14.261426 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 616/1210] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:14 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1655 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:15.280264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:15.281017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:15.287530 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:15.287987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:15.288766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:15.289202 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:15.348333 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:15.356050 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:15.357546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:15.358657 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-944aff76-e87b-403f-84ec-afc254ada204 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1366 microversion: 2.20 time: 0.083520 Jan 28 08:16:15.359214 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 595/1211] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:15 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:16.376525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:16.377138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:16.383433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:16.383886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:16.385248 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:16.385692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:16.442443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:16.450725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:16.452303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:16.453567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-08db256e-38e2-4157-a71b-aed5caaee4ca tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1366 microversion: 2.20 time: 0.080849 Jan 28 08:16:16.454554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 617/1212] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:16 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:17.474247 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:17.474864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:17.481187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:17.481644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:17.482429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:17.482870 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:17.513409 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:17.513866 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:17.514322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lazy-loading 'fault' on Instance uuid 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:16:17.555922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:17.580518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:17.580518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d8ece1530446b9b26d79403beef557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b89e609e844303aa304ec72a985cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:16:17.580518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-713e92e1-0264-46a1-852d-9f422fb5860e tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 200 len: 1371 microversion: 2.20 time: 0.108284 Jan 28 08:16:17.580990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 596/1213] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:17 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 08:16:18.596613 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:18.597230 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:18.604289 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:18.604741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:18.605548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:18.605987 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:18.620162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. Jan 28 08:16:18.620747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:18.621546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9042cf3f-adb2-4233-841e-56214224b0f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 404 len: 111 microversion: 2.20 time: 0.028677 Jan 28 08:16:18.622067 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 618/1214] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:18 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 08:16:18.630157 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-528f29f4-4043-4128-8210-8bdb4361b9f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '.version_select at 0x7f347404b5e0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:18.745058 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-528f29f4-4043-4128-8210-8bdb4361b9f6 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586294556" status: 204 len: 0 microversion: 2.20 time: 0.118501 Jan 28 08:16:18.745615 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 597/1215] 10.222.0.42 () {60 vars in 1261 bytes} [Fri Jan 28 08:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586294556 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 08:16:25.016852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:25.017358 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:25.023558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:25.024016 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:25.024788 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:25.025838 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:25.038940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. Jan 28 08:16:25.039616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:25.040420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d8f14fd7-010c-4a88-83f6-7d5c773a703b tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 404 len: 111 microversion: 2.20 time: 0.027262 Jan 28 08:16:25.040968 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 619/1216] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jan 28 08:16:25 2022] DELETE /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:16:25.048973 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:25.049582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: 08514332-3c4b-4cb7-a4fc-6fd6f733fc99] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:25.055851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:25.056299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:25.057062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:25.057495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:25.069898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. Jan 28 08:16:25.070468 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance 08514332-3c4b-4cb7-a4fc-6fd6f733fc99 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:25.071282 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b227eb3c-598b-42e8-bc4f-260107fd34f2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99" status: 404 len: 111 microversion: 2.20 time: 0.026433 Jan 28 08:16:25.072298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 598/1217] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:25 2022] GET /compute/v2.1/servers/08514332-3c4b-4cb7-a4fc-6fd6f733fc99 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 08:16:26.371614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:26.372094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:26.378735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:26.379238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:26.380127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:26.380622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:26.393683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. Jan 28 08:16:26.394261 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:26.395058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-06f67b50-b2d2-4f9a-87eb-88d2dc047fb2 tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 404 len: 111 microversion: 2.20 time: 0.028073 Jan 28 08:16:26.395605 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 620/1218] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jan 28 08:16:26 2022] DELETE /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 08:16:26.403421 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:26.404039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] [instance: eff2ba16-416f-418a-8b21-56d5ae8a2e32] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:16:26.410564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:26.411016 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:26.411815 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:16:26.412257 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:16:26.425493 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] HTTP exception thrown: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. Jan 28 08:16:26.426076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] Returning 404 to user: Instance eff2ba16-416f-418a-8b21-56d5ae8a2e32 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:26.426936 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f5765b1d-bf07-4b11-8f98-c518b1d35aba tempest-AttachVolumeShelveTestJSON-224618174 tempest-AttachVolumeShelveTestJSON-224618174-project] 10.222.0.42 "GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32" status: 404 len: 111 microversion: 2.20 time: 0.027193 Jan 28 08:16:26.427489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 599/1219] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jan 28 08:16:26 2022] GET /compute/v2.1/servers/eff2ba16-416f-418a-8b21-56d5ae8a2e32 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 08:16:31.820411 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-96a34972-eea6-44ef-8ec6-41a340a6266c tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Action: 'create', calling method: .version_select at 0x7f34741faee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-215885261"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:16:32.592649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-96a34972-eea6-44ef-8ec6-41a340a6266c tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.883855 Jan 28 08:16:32.593269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 621/1220] 10.222.0.42 () {60 vars in 1154 bytes} [Fri Jan 28 08:16:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 885 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 08:16:32.604497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aa0e9d57-d686-4bff-ae8d-559db71c8643 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f34741a93a0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:32.656877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aa0e9d57-d686-4bff-ae8d-559db71c8643 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 200 len: 344 microversion: 2.1 time: 0.056337 Jan 28 08:16:32.657458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 600/1221] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:16:32 2022] GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:33.669782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-415cc3e9-4521-411e-a253-893cd98b3f5d tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f347436e5e0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:33.716162 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-415cc3e9-4521-411e-a253-893cd98b3f5d tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 200 len: 345 microversion: 2.1 time: 0.050461 Jan 28 08:16:33.716715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 622/1222] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:16:33 2022] GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:33.728300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-42055bd6-9cf2-446e-82ec-0cdbe4e16d9b tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Action: 'create', calling method: .version_select at 0x7f347413c5e0>, body: {"snapshot": {"volume_id": "92e76b90-c5b2-4fbe-9937-72a5474adfde", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-730562037"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:16:34.270817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-42055bd6-9cf2-446e-82ec-0cdbe4e16d9b tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.546618 Jan 28 08:16:34.271458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 601/1223] 10.222.0.42 () {60 vars in 1161 bytes} [Fri Jan 28 08:16:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:34.282738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-960cfddd-2272-47be-b7a8-42cbf20de904 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f3474066820>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:34.312204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-960cfddd-2272-47be-b7a8-42cbf20de904 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.034103 Jan 28 08:16:34.313007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 623/1224] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:34 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:34.322478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b47fce1f-8f16-42b4-b659-c8c5530589e0 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346f708e50>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:34.350194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b47fce1f-8f16-42b4-b659-c8c5530589e0 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031324 Jan 28 08:16:34.350773 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 602/1225] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jan 28 08:16:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:16:34.361208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-752e00c5-a64e-451d-9740-a16dd63fd3ab tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f3474137c10>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:34.389262 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-752e00c5-a64e-451d-9740-a16dd63fd3ab tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.031625 Jan 28 08:16:34.389832 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 624/1226] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:34 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:35.401239 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9e2bf361-17a5-47a2-b078-2792374990b3 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346f6b9160>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:35.429252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9e2bf361-17a5-47a2-b078-2792374990b3 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.032082 Jan 28 08:16:35.429809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 603/1227] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:35 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:36.441633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ca8dd00a-98b7-4afd-8987-ea6443fff8d7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346ff47ca0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:36.470173 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ca8dd00a-98b7-4afd-8987-ea6443fff8d7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.032567 Jan 28 08:16:36.470743 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 625/1228] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:36 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:37.482800 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bb00fd8f-a71b-49af-bdcb-91cfea3c5169 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f347405d700>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:37.510964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bb00fd8f-a71b-49af-bdcb-91cfea3c5169 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.032237 Jan 28 08:16:37.511572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 604/1229] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:37 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:38.522642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4a3389cb-e68f-4c18-85ea-7ab35e4e1e5c tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f34741371f0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:38.551633 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4a3389cb-e68f-4c18-85ea-7ab35e4e1e5c tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 287 microversion: 2.1 time: 0.032971 Jan 28 08:16:38.555060 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 626/1230] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:38 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:38.563580 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-48838bf9-78b6-488c-9887-134992798d5f tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346f6aad30>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:38.681014 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-48838bf9-78b6-488c-9887-134992798d5f tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 202 len: 0 microversion: 2.1 time: 0.121465 Jan 28 08:16:38.681642 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 605/1231] 10.222.0.42 () {58 vars in 1253 bytes} [Fri Jan 28 08:16:38 2022] DELETE /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:16:38.689393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2b1b3114-b4f9-44d9-996b-afd887c3fce7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f34741370d0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:38.718404 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2b1b3114-b4f9-44d9-996b-afd887c3fce7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 200 len: 286 microversion: 2.1 time: 0.032546 Jan 28 08:16:38.718966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 627/1232] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:38 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:39.731893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d40414d4-20d1-4fad-b3ec-9edfb185db60 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f3475ee65e0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:39.755340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-d40414d4-20d1-4fad-b3ec-9edfb185db60 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] HTTP exception thrown: Snapshot 3d2baa44-6df6-4527-9ece-d7c45f1ea54c could not be found. Jan 28 08:16:39.755949 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-d40414d4-20d1-4fad-b3ec-9edfb185db60 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Returning 404 to user: Snapshot 3d2baa44-6df6-4527-9ece-d7c45f1ea54c could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:39.756781 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-d40414d4-20d1-4fad-b3ec-9edfb185db60 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c" status: 404 len: 111 microversion: 2.1 time: 0.030804 Jan 28 08:16:39.757332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 606/1233] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:16:39 2022] GET /compute/v2.1/os-snapshots/3d2baa44-6df6-4527-9ece-d7c45f1ea54c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:16:39.765917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9b8b860c-f665-4681-8866-d87ac402088a tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346ffd3940>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:40.013389 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9b8b860c-f665-4681-8866-d87ac402088a tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 202 len: 0 microversion: 2.1 time: 0.250918 Jan 28 08:16:40.017948 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 628/1234] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:16:39 2022] DELETE /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:16:40.024037 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-25d5177b-c285-4b02-90a7-45a4b79c03b3 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f346f708040>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:40.071718 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-25d5177b-c285-4b02-90a7-45a4b79c03b3 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 200 len: 344 microversion: 2.1 time: 0.051103 Jan 28 08:16:40.072433 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 607/1235] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:16:40 2022] GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:16:41.083891 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9aae265d-d034-48ec-9f2b-06690605e6ca tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f3474137940>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:41.109458 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-9aae265d-d034-48ec-9f2b-06690605e6ca tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] HTTP exception thrown: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. Jan 28 08:16:41.110049 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9aae265d-d034-48ec-9f2b-06690605e6ca tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Returning 404 to user: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:41.110870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9aae265d-d034-48ec-9f2b-06690605e6ca tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 404 len: 109 microversion: 2.1 time: 0.031169 Jan 28 08:16:41.111430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 629/1236] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:16:41 2022] GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:16:41.125451 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c20cf4b-cdca-4aa1-928b-3ea8391e3a37 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f347405ddc0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:41.152300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-3c20cf4b-cdca-4aa1-928b-3ea8391e3a37 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] HTTP exception thrown: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. Jan 28 08:16:41.152899 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3c20cf4b-cdca-4aa1-928b-3ea8391e3a37 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Returning 404 to user: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:41.153714 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3c20cf4b-cdca-4aa1-928b-3ea8391e3a37 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 404 len: 109 microversion: 2.1 time: 0.032884 Jan 28 08:16:41.154523 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 608/1237] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jan 28 08:16:41 2022] DELETE /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:16:41.165953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-05b0e845-8db3-48b6-8b0a-2e9e4b8526f7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Calling method '.version_select at 0x7f34741485e0>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:16:41.188654 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-05b0e845-8db3-48b6-8b0a-2e9e4b8526f7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] HTTP exception thrown: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. Jan 28 08:16:41.192845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-05b0e845-8db3-48b6-8b0a-2e9e4b8526f7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] Returning 404 to user: Volume 92e76b90-c5b2-4fbe-9937-72a5474adfde could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:16:41.192845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-05b0e845-8db3-48b6-8b0a-2e9e4b8526f7 tempest-VolumesSnapshotsTestJSON-331114256 tempest-VolumesSnapshotsTestJSON-331114256-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde" status: 404 len: 109 microversion: 2.1 time: 0.031397 Jan 28 08:16:41.192845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 630/1238] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jan 28 08:16:41 2022] GET /compute/v2.1/os-volumes/92e76b90-c5b2-4fbe-9937-72a5474adfde => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 08:17:53.922817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:17:53.923802 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:18:01.869216 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'create', calling method: .version_select at 0x7f347413d940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2005088894"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:01.883122 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for project ff40033414ee40039e6fc44d7cd93f76. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:18:01.886915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for user 6123a31288174cd0b29bd61898141bee and project ff40033414ee40039e6fc44d7cd93f76. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:18:02.118444 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for project ff40033414ee40039e6fc44d7cd93f76. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:18:02.122105 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for user 6123a31288174cd0b29bd61898141bee and project ff40033414ee40039e6fc44d7cd93f76. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:18:02.135133 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a295c5d6-ce0c-4e0e-a465-79b104a14172 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.271557 Jan 28 08:18:02.135766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 609/1239] 10.222.0.42 () {60 vars in 1157 bytes} [Fri Jan 28 08:18:01 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:02.199415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-205332452", "imageRef": "001cd8cf-891d-4c4f-8215-12d2f3c7cadf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2005088894", "networks": [{"uuid": "37332855-2637-4b27-9a5d-c2b76348ae41"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:02.247775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] validate_networks() for [('37332855-2637-4b27-9a5d-c2b76348ae41', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:18:02.702663 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:18:02.703088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:18:02.703585 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:18:02.703998 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:18:02.704403 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:18:02.713421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:02.713864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:02.714657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:02.715090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:02.731174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for project ff40033414ee40039e6fc44d7cd93f76. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:18:02.735336 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Getting quotas for user 6123a31288174cd0b29bd61898141bee and project ff40033414ee40039e6fc44d7cd93f76. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:18:02.745657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:18:02.747795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001cd8cf-891d-4c4f-8215-12d2f3c7cadf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:18:02.865106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-17a540d3-5094-44d9-aff0-a1ca7760f3c8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670627 Jan 28 08:18:02.865927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 631/1240] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:18:02.875733 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e20f0a8f-526f-45a1-aa2d-5dcb0edf1aa0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:02.876356 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e20f0a8f-526f-45a1-aa2d-5dcb0edf1aa0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:02.927686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e20f0a8f-526f-45a1-aa2d-5dcb0edf1aa0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:02.934476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e20f0a8f-526f-45a1-aa2d-5dcb0edf1aa0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1258 microversion: 2.1 time: 0.062811 Jan 28 08:18:02.935052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 610/1241] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:02 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1258 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:03.951192 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-4803723a-f00e-4ad5-8714-c38ee89baeef tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:03.951907 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-4803723a-f00e-4ad5-8714-c38ee89baeef tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:04.004456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-4803723a-f00e-4ad5-8714-c38ee89baeef tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:04.010936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-4803723a-f00e-4ad5-8714-c38ee89baeef tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1258 microversion: 2.1 time: 0.063516 Jan 28 08:18:04.011528 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 632/1242] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:03 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:05.027013 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:05.027688 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:05.033447 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:05.038853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:05.038853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:05.038853 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:05.095894 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:05.104117 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-310e8e1e-1a96-45b7-a1af-54f6ce37da75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1254 microversion: 2.1 time: 0.081222 Jan 28 08:18:05.104675 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 611/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:05 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:06.120322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:06.120934 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:06.132187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:06.132637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:06.133427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:06.133857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:06.201017 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:06.211072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-38de670b-7731-4505-8b77-e5237656e35d tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1316 microversion: 2.1 time: 0.094548 Jan 28 08:18:06.211675 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 633/1244] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:06 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:07.232945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:07.233570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:07.240533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:07.240989 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:07.241790 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:07.242232 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:07.380979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:07.388784 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-80a48ee1-6ede-4ea3-b9b0-ef435b631739 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.159797 Jan 28 08:18:07.389357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 612/1245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:07 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:08.405922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:08.406731 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:08.413635 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:08.414088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:08.414878 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:08.415335 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:08.547871 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:08.555739 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3ac1ecb3-7741-4027-8bcc-3e6adad550fe tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.153494 Jan 28 08:18:08.556307 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 634/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:08 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:18:09.573438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:09.574149 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:09.580644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:09.581093 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:09.581864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:09.582294 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:09.707021 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:09.714931 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-18f7666f-ea1c-4f61-a691-8ccc10df9ea3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.145759 Jan 28 08:18:09.715545 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 613/1247] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:09 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:10.732013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:10.733154 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:10.739372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:10.739899 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:10.740683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:10.741124 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:10.867327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:10.874600 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-efc4212a-4d5e-44e6-8b8f-c91f4f68667b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.146450 Jan 28 08:18:10.875184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 635/1248] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:10 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:11.891750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:11.892434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:11.898573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:11.899017 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:11.899855 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:11.900288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:12.039679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:12.048722 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3387627d-29d7-4aff-b948-a8a2e9af329c tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.160475 Jan 28 08:18:12.049670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 614/1249] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:11 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:13.066533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:13.067213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:13.073535 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:13.073995 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:13.074775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:13.075212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:13.201338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:13.208966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b77afda7-f354-4192-a0b2-4ec9f12ae11e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.146021 Jan 28 08:18:13.209526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 636/1250] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:13 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:14.225862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:14.226573 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:14.233203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:14.233659 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:14.234456 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:14.234945 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:14.406301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:14.417332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4f17bb0c-5b3d-4968-9a14-edba5f0c28d5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.195070 Jan 28 08:18:14.418309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 615/1251] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:14 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:15.433890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:15.435196 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:15.443018 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:15.443691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:15.444715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:15.445232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:15.613315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:15.620851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5630190a-ee8d-4be0-bb21-95552a16a110 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.190805 Jan 28 08:18:15.627294 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 637/1252] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:15 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:16.638976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:16.639715 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:16.646396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:16.646852 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:16.647679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:16.648155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:16.805823 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:16.814783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5902546f-d698-4fa0-8ca3-b3f83b664ed5 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.180301 Jan 28 08:18:16.815817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 616/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:16 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:17.029807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:18:17.030450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:18:17.832110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:17.836296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:17.839276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:17.839642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:17.840421 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:17.840851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:17.968976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:17.976247 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f9c1bb7f-787f-4b5c-a32b-86524e3767fc tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.148055 Jan 28 08:18:17.976817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 638/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:17 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:18:18.993450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:18.994176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:19.000702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:19.001159 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:19.001985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:19.002417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:19.245091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:19.253509 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4f1ce22e-462f-43db-a600-925d0060507b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.263634 Jan 28 08:18:19.254489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 617/1255] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:18 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:19.940490 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-3d06e30c-a814-46f8-b53a-e972f2aec233 req-44a202b0-bed0-40e3-aacb-d52dca34187c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:19.942941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:18:19.942941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:18:19.950074 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3d06e30c-a814-46f8-b53a-e972f2aec233 req-44a202b0-bed0-40e3-aacb-d52dca34187c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:19.950531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-3d06e30c-a814-46f8-b53a-e972f2aec233 req-44a202b0-bed0-40e3-aacb-d52dca34187c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:19.961807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-3d06e30c-a814-46f8-b53a-e972f2aec233 req-44a202b0-bed0-40e3-aacb-d52dca34187c service nova] Creating event network-changed:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:18:19.969055 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-3d06e30c-a814-46f8-b53a-e972f2aec233 req-44a202b0-bed0-40e3-aacb-d52dca34187c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166773 Jan 28 08:18:19.969723 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 639/1256] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:18:20.269911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:20.270758 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:20.277252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:20.277776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:20.278575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:20.279012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:20.448443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:20.456982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-635b6f6c-fe0e-44dc-9cbc-3c2df478b416 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.190888 Jan 28 08:18:20.457579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 618/1257] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:20 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:18:21.475757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:21.476440 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:21.483316 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:21.484084 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:21.485430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:21.486140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:21.617241 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:21.624542 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-de9899f7-e843-42f5-91c7-286d0b191025 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.153648 Jan 28 08:18:21.625096 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 640/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:21 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:22.647518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:22.648137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:22.654453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:22.657260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:22.657260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:22.657260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:22.781374 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:22.789035 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-df198545-d346-4307-9718-d9431af6a525 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.145534 Jan 28 08:18:22.789277 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 619/1259] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:22 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:23.805132 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:23.805752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:23.812001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:23.812456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:23.813233 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:23.813673 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:23.937717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:23.944953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cfe55466-5ef5-4875-b513-e980943038de tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.143479 Jan 28 08:18:23.945503 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 641/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:23 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:24.961948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:24.962616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:24.969765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:24.970325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:24.971200 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:24.971736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:25.104555 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:25.111884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1e1b3662-4c4c-487e-96f1-6cfda7a72a10 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.153706 Jan 28 08:18:25.112587 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 620/1261] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:24 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:26.129551 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:26.130090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:26.136483 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:26.136933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:26.137727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:26.138156 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:26.272673 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:26.280271 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3bb9f065-1bee-46e6-b053-b71966ac9963 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.155007 Jan 28 08:18:26.280839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 642/1262] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:26 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:26.942368 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-17b2d819-98e7-4a46-9c22-0b69c80654bf req-8545a64a-9bdd-40a7-ac7d-cdd20a64d87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "name": "network-vif-plugged", "status": "completed", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:26.944082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:18:26.944082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:18:26.951147 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-17b2d819-98e7-4a46-9c22-0b69c80654bf req-8545a64a-9bdd-40a7-ac7d-cdd20a64d87a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:26.951713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-17b2d819-98e7-4a46-9c22-0b69c80654bf req-8545a64a-9bdd-40a7-ac7d-cdd20a64d87a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:26.962999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-17b2d819-98e7-4a46-9c22-0b69c80654bf req-8545a64a-9bdd-40a7-ac7d-cdd20a64d87a service nova] Creating event network-vif-plugged:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:18:26.967976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-17b2d819-98e7-4a46-9c22-0b69c80654bf req-8545a64a-9bdd-40a7-ac7d-cdd20a64d87a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143456 Jan 28 08:18:26.968560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 621/1263] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:18:27.297570 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:27.298109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:27.305168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:27.305616 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:27.306386 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:27.306814 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:27.435302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:27.442519 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-de691190-63f8-4d7f-9a7a-2ac5f3bfb26e tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.148711 Jan 28 08:18:27.443098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 643/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:27 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:28.460298 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:28.461006 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:28.467056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:28.467550 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:28.468342 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:28.473125 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:28.610977 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:28.619144 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-95ef8663-5f8b-4bb2-9d0d-0ef378273947 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1358 microversion: 2.1 time: 0.163431 Jan 28 08:18:28.619643 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 622/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:28 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:29.634939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:29.635601 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:29.642093 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.642563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:29.643433 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.644522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:29.769129 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:29.776777 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-377cb173-71af-44fa-9169-e42c0ec63ec6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1547 microversion: 2.1 time: 0.145671 Jan 28 08:18:29.777346 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 644/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:29 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:29.792631 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:29.793252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:29.799599 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.802809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:29.802809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.802809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:29.931176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:29.938813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-24441993-a5c8-4ace-9c76-a38b437e194a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1547 microversion: 2.1 time: 0.149917 Jan 28 08:18:29.939417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 623/1267] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:29 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:29.954944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:29.958475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:18:29.958475 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:18:29.963505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:29.963505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Searching by: {'deleted': False, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76'} {{(pid=116947) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 28 08:18:29.966683 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.967138 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:29.967981 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:29.968420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:30.057489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.multi_cell_list [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116947) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 28 08:18:30.146640 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d0ad1a7d-0f3c-48cf-8472-ca6f982b2976 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.195291 Jan 28 08:18:30.147223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 645/1268] 10.222.0.42 () {58 vars in 1124 bytes} [Fri Jan 28 08:18:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:18:30.157649 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:30.158438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:30.164702 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:30.165153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:30.165928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:30.166365 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:30.290713 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:30.298052 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-565231af-f755-40c8-8d34-74b2221bd89f tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1547 microversion: 2.1 time: 0.144005 Jan 28 08:18:30.298621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 624/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:30 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:32.085715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e99783-cadd-4cd0-9151-fd292907a345"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:32.086826 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:32.093024 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:32.093482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:32.094257 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:32.094698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:33.127614 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8a91ec0f-0498-4484-8e8a-3f9069b37a2b tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045278 Jan 28 08:18:33.128692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 646/1270] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jan 28 08:18:32 2022] POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:18:40.649355 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:40.650231 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:40.656205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:40.656656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:40.657425 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:40.657859 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:40.779174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:40.786812 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c6f0ad57-f103-4739-8910-2bcc13a9e079 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1593 microversion: 2.1 time: 0.141108 Jan 28 08:18:40.787401 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 625/1271] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:40 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1593 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:42.825465 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-d147f25c-c0bb-4c34-917e-12fa7af5450a req-68e296d0-203c-43c5-b538-206a5166331a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:42.827578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:18:42.827578 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:18:42.835520 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d147f25c-c0bb-4c34-917e-12fa7af5450a req-68e296d0-203c-43c5-b538-206a5166331a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:42.836243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d147f25c-c0bb-4c34-917e-12fa7af5450a req-68e296d0-203c-43c5-b538-206a5166331a service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:42.851268 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-d147f25c-c0bb-4c34-917e-12fa7af5450a req-68e296d0-203c-43c5-b538-206a5166331a service nova] Creating event network-changed:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:18:42.856434 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-d147f25c-c0bb-4c34-917e-12fa7af5450a req-68e296d0-203c-43c5-b538-206a5166331a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035146 Jan 28 08:18:42.857321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 647/1272] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:18:45.343156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1008543830"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:45.343156 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:45.346450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:45.346900 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:45.347701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:45.348139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:45.469066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.network.security_group_api [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Adding security group 919f6ea7-0b0e-4616-b7bd-2f1669cab330 to port ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a Jan 28 08:18:45.900849 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ca618dd5-0b4d-45e3-92d5-c9790c779c4a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.563650 Jan 28 08:18:45.901136 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 626/1273] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:18:45 2022] POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:18:45.908448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-cb4c3c19-90e6-4c7a-9ba3-252c142d5b22 req-f6912a1a-2995-415e-818b-230574c99805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:18:45.910119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:18:45.910119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:18:45.910322 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:18:45.910813 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:18:45.917860 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-cb4c3c19-90e6-4c7a-9ba3-252c142d5b22 req-f6912a1a-2995-415e-818b-230574c99805 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:45.918639 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-cb4c3c19-90e6-4c7a-9ba3-252c142d5b22 req-f6912a1a-2995-415e-818b-230574c99805 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:45.926541 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:45.927435 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:45.928581 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:18:45.929711 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:18:45.931289 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-cb4c3c19-90e6-4c7a-9ba3-252c142d5b22 req-f6912a1a-2995-415e-818b-230574c99805 service nova] Creating event network-changed:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:18:45.936869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-cb4c3c19-90e6-4c7a-9ba3-252c142d5b22 req-f6912a1a-2995-415e-818b-230574c99805 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032809 Jan 28 08:18:45.940970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 648/1274] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:18:46.189028 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:18:46.199636 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8fcf5c3a-0890-4ebd-b8b5-1c2989e1ce27 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1759 microversion: 2.1 time: 0.293090 Jan 28 08:18:46.200305 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 627/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:18:45 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1759 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:18:53.912941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:18:53.913418 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:19:34.373972 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:19:34.375005 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:34.381117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:34.381562 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:34.382325 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:34.382750 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:34.600929 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6d19cde1-9c74-4383-981e-14a49cb69ec0 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.231484 Jan 28 08:19:34.601672 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 649/1276] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:19:34 2022] POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:19:34.609380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:34.612247 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:34.616170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:34.616658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:34.617495 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:34.617935 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:34.757070 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:34.765169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-436fd2c0-de83-4f5b-a3a1-d3673e821cc4 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1751 microversion: 2.1 time: 0.159535 Jan 28 08:19:34.765750 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 628/1277] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:34 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:35.783594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:35.784310 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:35.790655 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:35.791109 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:35.791965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:35.792400 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:35.930051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:35.937919 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-67a7b689-4764-4e3b-80ab-53845a47a500 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.158356 Jan 28 08:19:35.938492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 650/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:35 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:36.955757 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:36.957222 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:36.964010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:36.964465 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:36.965242 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:36.965674 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:37.112705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:37.121221 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1e451c27-1621-4d90-adac-a764373af674 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.169121 Jan 28 08:19:37.121795 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 629/1279] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:36 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:38.138415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:38.138993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:38.145951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:38.146407 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:38.147177 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:38.147644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:38.287321 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:38.294908 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-09beada1-e3bf-46cd-8cec-989a4d86fe75 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.160305 Jan 28 08:19:38.295503 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 651/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:38 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:39.311174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:39.311824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:39.318660 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:39.319137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:39.319947 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:39.320388 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:39.459842 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:39.467879 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-132ba20b-92df-4363-9af7-6a964aee4802 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.160388 Jan 28 08:19:39.468452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 630/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:39 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:40.485723 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:40.486327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:40.492251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:40.492695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:40.493452 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:40.493883 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:40.629956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:40.637767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-483043ab-a8ef-48b3-b4e2-a82b2aacac70 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.155867 Jan 28 08:19:40.638333 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 652/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:40 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:41.655567 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:41.656184 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:41.663097 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:41.663575 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:41.664354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:41.664798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:41.804933 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:41.812841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-872afb39-595c-433f-a521-d52a41c62f03 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.160953 Jan 28 08:19:41.813394 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 631/1283] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:41 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:42.829631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:42.830251 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:42.836474 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:42.836931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:42.837738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:42.838183 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:42.973555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:42.981193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5c4e0107-beea-4bb7-b7cb-c7b3c6e6eff1 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.155221 Jan 28 08:19:42.981807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 653/1284] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:42 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:43.998765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:43.999426 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:44.006198 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:44.006642 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:44.007437 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:44.007868 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:44.144005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:44.151983 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-74e7bfc8-e51f-4d21-8286-6e2691409e04 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.156881 Jan 28 08:19:44.152546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 632/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:43 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:45.169059 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:45.169652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:45.175946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:45.176399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:45.177176 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:45.177610 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:45.316886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:45.325717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-02e31571-7678-41da-a54b-7045ec4e38ce tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1756 microversion: 2.1 time: 0.160006 Jan 28 08:19:45.325977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 654/1286] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:45 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:19:46.341979 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:19:46.342644 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:19:46.349560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:46.350028 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:46.350792 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:19:46.351229 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:19:46.491986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:19:46.499805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-2b255958-e1a1-4dda-8298-dd58faaec0ad tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1759 microversion: 2.1 time: 0.161546 Jan 28 08:19:46.500369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 633/1287] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:19:46 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:20:49.786201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1008543830"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:20:49.786864 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:49.792670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:49.793120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:49.793895 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:49.794333 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:49.919092 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.network.security_group_api [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Removing security group 919f6ea7-0b0e-4616-b7bd-2f1669cab330 from port ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a Jan 28 08:20:50.362911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8c97dd8b-f9ab-408b-a408-af0e822e0c91 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.581434 Jan 28 08:20:50.363753 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 655/1288] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:20:49 2022] POST /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:20:50.607281 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:20:50.609053 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:20:50.609053 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:20:50.616207 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:50.616874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:50.633441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] Creating event network-changed:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:20:50.644452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: ERROR oslo.messaging._drivers.impl_rabbit [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] [72f3f1e4-23ac-4982-8671-2f561b82db48] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 08:20:51.597406 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:51.597914 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:51.604034 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:51.604494 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:51.605342 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:51.605783 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:51.646025 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] [72f3f1e4-23ac-4982-8671-2f561b82db48] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48640. Jan 28 08:20:51.650656 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-d7bd69ea-6dac-4c1c-ab80-3e0d8d700df8 req-471e87bb-b6e6-4628-bf1c-f9246f1d4352 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.280864 Jan 28 08:20:51.651274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 634/1289] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:20:51.695081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lazy-loading 'services' on Instance uuid 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:20:51.922669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6b0afda6-4a71-47f1-b7f7-701e860e11e8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments/a0e99783-cadd-4cd0-9151-fd292907a345" status: 202 len: 0 microversion: 2.1 time: 0.329427 Jan 28 08:20:51.932002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 656/1290] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:20:51 2022] DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments/a0e99783-cadd-4cd0-9151-fd292907a345 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 08:20:51.938778 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:51.939860 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:51.949669 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:51.950120 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:51.950899 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:51.951363 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:51.982728 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6eb6106d-cfc1-4ea6-a17f-b72ecea8440a tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052897 Jan 28 08:20:51.983416 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 635/1291] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:20:51 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:20:52.995467 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:52.996525 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:53.002488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:53.002944 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:53.003782 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:53.004267 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:53.032852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-26e01626-0c92-4864-a776-eb153ddbb9b3 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041995 Jan 28 08:20:53.033415 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 657/1292] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jan 28 08:20:52 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 08:20:53.043603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:53.044123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:53.050115 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:53.050570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:53.051890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:53.052337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:53.127511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] HTTP exception thrown: Instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb is not attached to volume a0e99783-cadd-4cd0-9151-fd292907a345 Jan 28 08:20:53.128115 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Returning 404 to user: Instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb is not attached to volume a0e99783-cadd-4cd0-9151-fd292907a345 {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:20:53.128950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-948a557d-f655-460d-baf6-111f4d541167 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments/a0e99783-cadd-4cd0-9151-fd292907a345" status: 404 len: 154 microversion: 2.1 time: 0.089372 Jan 28 08:20:53.130145 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 636/1293] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jan 28 08:20:53 2022] DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb/os-volume_attachments/a0e99783-cadd-4cd0-9151-fd292907a345 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:20:53.665448 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-f4ceab3d-2938-4dd7-b877-af76ce00b9c2 req-e957dbf2-4c45-407b-91d0-cabc03fd61aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:20:53.667031 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:20:53.667031 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:20:53.673774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-f4ceab3d-2938-4dd7-b877-af76ce00b9c2 req-e957dbf2-4c45-407b-91d0-cabc03fd61aa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:53.674219 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-f4ceab3d-2938-4dd7-b877-af76ce00b9c2 req-e957dbf2-4c45-407b-91d0-cabc03fd61aa service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:53.684715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-f4ceab3d-2938-4dd7-b877-af76ce00b9c2 req-e957dbf2-4c45-407b-91d0-cabc03fd61aa service nova] Creating event network-changed:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:20:53.689607 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-f4ceab3d-2938-4dd7-b877-af76ce00b9c2 req-e957dbf2-4c45-407b-91d0-cabc03fd61aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028478 Jan 28 08:20:53.697178 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 658/1294] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:20:54.412019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:54.412560 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:54.418794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:54.419264 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:54.420060 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:54.420500 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:54.445533 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:20:54.726918 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-107f7bff-d256-465a-8498-5d3f82db1ac6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 204 len: 0 microversion: 2.1 time: 0.318241 Jan 28 08:20:54.727590 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 637/1295] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:20:54 2022] DELETE /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:20:54.736703 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:54.737480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:54.744429 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:54.744879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:54.745649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:54.746081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:54.872370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:20:54.879577 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-61ad237f-f76a-4a92-b5bf-7dfbd1c009e6 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1553 microversion: 2.1 time: 0.147292 Jan 28 08:20:54.880153 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 659/1296] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:20:54 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:20:55.897091 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:55.897797 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:55.904092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:55.904549 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:55.905331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:55.905772 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:56.029782 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:20:56.037326 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5cf7653b-65af-4851-be73-fd2d86077a83 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1553 microversion: 2.1 time: 0.144516 Jan 28 08:20:56.037895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 638/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:20:55 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:20:57.054214 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:57.054841 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:57.061211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:57.061669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:57.062450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:57.062890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:57.190844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6123a31288174cd0b29bd61898141bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff40033414ee40039e6fc44d7cd93f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:20:57.198721 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a98b540c-32e8-491a-91d7-f3ca1a9498ea tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 200 len: 1553 microversion: 2.1 time: 0.148453 Jan 28 08:20:57.199311 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 660/1298] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:20:57 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:20:57.295081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-bfb236a7-37a3-4cef-864a-40d384fa0a04 req-264eea29-125b-4e8f-8fe3-660974ffce20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751a99a1-076a-4a00-80b7-8fa2dd3c7dbb", "name": "network-vif-deleted", "tag": "ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:20:57.296646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:20:57.296646 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:20:57.304434 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-bfb236a7-37a3-4cef-864a-40d384fa0a04 req-264eea29-125b-4e8f-8fe3-660974ffce20 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:57.307227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-bfb236a7-37a3-4cef-864a-40d384fa0a04 req-264eea29-125b-4e8f-8fe3-660974ffce20 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:57.315984 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-bfb236a7-37a3-4cef-864a-40d384fa0a04 req-264eea29-125b-4e8f-8fe3-660974ffce20 service nova] Creating event network-vif-deleted:ff36a8c5-3b84-436c-8ef9-fef3e1a4f47a for instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb on hv-cinder-80403 Jan 28 08:20:57.324504 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-bfb236a7-37a3-4cef-864a-40d384fa0a04 req-264eea29-125b-4e8f-8fe3-660974ffce20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Jan 28 08:20:57.324967 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 639/1299] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:20:58.215657 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:58.216288 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] [instance: 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:20:58.222443 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:58.222918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:58.223727 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:20:58.224206 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:20:58.237637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] HTTP exception thrown: Instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb could not be found. Jan 28 08:20:58.238224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Returning 404 to user: Instance 751a99a1-076a-4a00-80b7-8fa2dd3c7dbb could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:20:58.239023 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-db930c28-626e-4cda-91f9-a4e8e4368747 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb" status: 404 len: 111 microversion: 2.1 time: 0.027221 Jan 28 08:20:58.239588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 661/1300] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:20:58 2022] GET /compute/v2.1/servers/751a99a1-076a-4a00-80b7-8fa2dd3c7dbb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:20:58.248244 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4a0e6888-bf6f-4acf-a887-33bb6ba856a8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] Calling method '.version_select at 0x7f34741d79d0>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:20:58.312986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4a0e6888-bf6f-4acf-a887-33bb6ba856a8 tempest-TestMinimumBasicScenario-1699571887 tempest-TestMinimumBasicScenario-1699571887-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2005088894" status: 202 len: 0 microversion: 2.1 time: 0.068762 Jan 28 08:20:58.313840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 640/1301] 10.222.0.42 () {58 vars in 1271 bytes} [Fri Jan 28 08:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2005088894 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:21:11.700007 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:21:11.700549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:21:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:21:13.937917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:21:13.938395 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:21:21.240917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Action: 'create', calling method: .version_select at 0x7f3474148310>, body: {"keypair": {"name": "tempest-TestShelveInstance-817943199"}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:21:21.255456 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:21:21.259377 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for user cc1f91a47f18495c9bc348f97b8875fb and project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:21:21.420022 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:21:21.423790 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for user cc1f91a47f18495c9bc348f97b8875fb and project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'key_pairs'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:21:21.437091 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-96f071fc-e0ef-4e60-9a57-79058d3b98fc tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.372660 Jan 28 08:21:21.437936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 662/1302] 10.222.0.42 () {60 vars in 1157 bytes} [Fri Jan 28 08:21:21 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:44.391877 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1480523482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-817943199", "security_groups": [{"name": "tempest-secgroup-smoke-1693572241"}], "networks": [{"uuid": "129af3b2-6802-4fd7-919f-feacb6e970cf"}], "block_device_mapping_v2": [{"uuid": "6d55e697-adc3-45cf-b198-408aaf3facef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:21:44.620922 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] validate_networks() for [('129af3b2-6802-4fd7-919f-feacb6e970cf', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:21:45.070470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:21:45.070893 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:21:45.071407 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:21:45.071817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:21:45.072301 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:21:45.080794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:45.081237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:45.082043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:45.083092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:45.099397 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:21:45.103205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Getting quotas for user cc1f91a47f18495c9bc348f97b8875fb and project ac325dcba6fe455e8a46e1a80548d4fb. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:21:45.164898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:21:45.164898 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d55e697-adc3-45cf-b198-408aaf3facef',volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:21:45.585126 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3a023347-3a2c-43d8-8e96-23c04c0687bd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.197375 Jan 28 08:21:45.585737 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 641/1303] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:21:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:21:45.596037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e221a5ed-dc9f-45cf-a070-7bbbec114e47 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:45.596741 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e221a5ed-dc9f-45cf-a070-7bbbec114e47 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:45.702901 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e221a5ed-dc9f-45cf-a070-7bbbec114e47 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:45.709481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e221a5ed-dc9f-45cf-a070-7bbbec114e47 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1088 microversion: 2.1 time: 0.117860 Jan 28 08:21:45.710045 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 663/1304] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:45 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1088 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:46.726170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:46.726791 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:46.733151 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:46.733632 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:46.734459 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:46.734895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:46.793252 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:46.800691 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-862159cf-faa2-40ac-be18-250d4b057d5f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1138 microversion: 2.1 time: 0.078726 Jan 28 08:21:46.801828 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 642/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:46 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:47.817979 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:47.818592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:47.825658 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:47.826110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:47.826885 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:47.827353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:47.886427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:47.896218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-b88aa597-5681-4832-bd2e-d6c19cc94f91 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1204 microversion: 2.1 time: 0.082249 Jan 28 08:21:47.897226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 664/1306] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:47 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:48.913775 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:48.915808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:48.920739 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:48.921187 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:48.921971 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:48.922393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:49.143711 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:49.151606 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1d2f2202-5fe4-4c7b-b96f-4bb10f55a84e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1272 microversion: 2.1 time: 0.242065 Jan 28 08:21:49.152184 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 643/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:48 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:49.303106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-7dcaf15e-bbdb-48ad-88df-2dc0dad04c87 req-4aa4c356-e02f-4e0f-99de-793cfddfc323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:21:49.304966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:21:49.304966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:21:49.314088 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-7dcaf15e-bbdb-48ad-88df-2dc0dad04c87 req-4aa4c356-e02f-4e0f-99de-793cfddfc323 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:49.314802 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-7dcaf15e-bbdb-48ad-88df-2dc0dad04c87 req-4aa4c356-e02f-4e0f-99de-793cfddfc323 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:49.331641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-7dcaf15e-bbdb-48ad-88df-2dc0dad04c87 req-4aa4c356-e02f-4e0f-99de-793cfddfc323 service nova] Creating event network-changed:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:21:49.337362 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-7dcaf15e-bbdb-48ad-88df-2dc0dad04c87 req-4aa4c356-e02f-4e0f-99de-793cfddfc323 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038745 Jan 28 08:21:49.337993 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 665/1308] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:21:50.169064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:50.169686 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:50.176665 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:50.177115 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:50.177890 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:50.178325 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:50.304841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:50.312292 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1ff1ed0a-3dd8-4339-ae8c-8a8b583f71eb tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.146968 Jan 28 08:21:50.312862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 644/1309] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:50 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:51.329854 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:51.330580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:51.336665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:51.337117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:51.337875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:51.338302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:51.464622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:51.471706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e30b36d6-27d5-4324-995f-8df8be818a37 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.146327 Jan 28 08:21:51.472264 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 666/1310] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:51 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:52.488520 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:52.489142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:52.495794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:52.496242 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:52.497024 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:52.497458 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:52.627300 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:52.634709 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3ffb82be-67e4-424d-96e9-d020e1221945 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.149980 Jan 28 08:21:52.635311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 645/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:52 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:53.650884 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:53.651463 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:53.657755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:53.658204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:53.658966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:53.659430 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:53.787959 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:53.795083 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7f90d9fb-1223-40c8-ab3d-980cfdaec89a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.147998 Jan 28 08:21:53.795695 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 667/1312] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:53 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:54.812205 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:54.812824 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:54.819746 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:54.820193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:54.820963 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:54.821399 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:54.950126 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:54.957882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-399142c0-593f-4f5b-9f15-48a7bb20c97f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.148910 Jan 28 08:21:54.958442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 646/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:54 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:55.973636 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:55.974252 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:55.981136 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:55.981577 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:55.982343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:55.982775 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:56.108398 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:56.115670 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a39cc9ee-c9dd-47af-a2bf-12be6c844c9c tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.145668 Jan 28 08:21:56.116243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 668/1314] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:55 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:57.132732 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:57.133398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:57.139705 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:57.143038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:57.143038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:57.143038 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:57.272829 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:57.280061 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f99a1b95-a527-4b64-a3c7-4b4a9b267196 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.151133 Jan 28 08:21:57.280624 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 647/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:57 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:58.297387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:58.297954 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:58.304738 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:58.307893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:58.307893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:58.307893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:58.434211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:58.441469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-27ae6c4c-451a-4eda-9972-0d39d63bcc5b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.147890 Jan 28 08:21:58.442029 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 669/1316] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:58 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:21:59.506489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:21:59.507104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:21:59.513295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:59.514085 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:59.514506 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:21:59.514942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:21:59.648124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:21:59.655473 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6a5e3e87-7e16-4bde-8fe5-6675ba048a1e tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.153326 Jan 28 08:21:59.656100 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 648/1317] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:21:59 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:00.671396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:22:00.672039 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:22:00.678200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:00.678649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:00.679454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:00.679886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:00.809575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:22:00.817559 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5e5cbf8c-97a7-49bb-be67-86dd34970e93 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.149823 Jan 28 08:22:00.818141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 670/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:22:00 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:01.726278 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-b2301a93-0619-4f40-b451-0cc6835a40a9 req-14e4c0bb-acf4-4b53-a1cf-21c010f29fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "name": "network-vif-plugged", "status": "completed", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:22:01.740189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:22:01.740189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:22:01.740189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-b2301a93-0619-4f40-b451-0cc6835a40a9 req-14e4c0bb-acf4-4b53-a1cf-21c010f29fdf service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:01.740189 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-b2301a93-0619-4f40-b451-0cc6835a40a9 req-14e4c0bb-acf4-4b53-a1cf-21c010f29fdf service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:01.745419 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-b2301a93-0619-4f40-b451-0cc6835a40a9 req-14e4c0bb-acf4-4b53-a1cf-21c010f29fdf service nova] Creating event network-vif-plugged:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:22:01.750345 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-b2301a93-0619-4f40-b451-0cc6835a40a9 req-14e4c0bb-acf4-4b53-a1cf-21c010f29fdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028855 Jan 28 08:22:01.750924 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 649/1319] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:22:01.834240 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:22:01.834955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:22:01.841110 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:01.841555 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:01.842317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:01.842747 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:01.974567 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:22:01.981805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bd004261-da28-4d9f-aac4-93060c8d8d54 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.151721 Jan 28 08:22:01.982369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 671/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:22:01 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:02.999119 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:22:02.999847 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:22:03.006406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:03.006859 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:03.007658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:03.008095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:03.146410 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:22:03.153703 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e0839cc1-c0c4-454c-b1d5-def2a8a7a472 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1260 microversion: 2.1 time: 0.159005 Jan 28 08:22:03.154267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 650/1321] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:22:02 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:04.170218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:22:04.170825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:22:04.177537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:04.177990 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:04.178757 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:04.179210 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:04.307953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:22:04.315395 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-44a1a94e-500c-4296-b8c0-9b8228a8599a tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1443 microversion: 2.1 time: 0.148825 Jan 28 08:22:04.316594 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 672/1322] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:22:04 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:04.332212 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:22:04.332834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:22:04.338589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:04.339053 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:04.339857 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:04.340299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:04.466036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:22:04.473865 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-16b89fb1-37c4-4988-a450-000a0a00e345 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1443 microversion: 2.1 time: 0.145499 Jan 28 08:22:04.474429 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 651/1323] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:22:04 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:22:06.429184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-9ed40b1f-2b11-47bc-858d-fdd117855533 req-40538c2e-4e4f-48ba-bad0-a0cd142a0f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:22:06.431540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:22:06.431540 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:22:06.439812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-9ed40b1f-2b11-47bc-858d-fdd117855533 req-40538c2e-4e4f-48ba-bad0-a0cd142a0f36 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:22:06.440281 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-9ed40b1f-2b11-47bc-858d-fdd117855533 req-40538c2e-4e4f-48ba-bad0-a0cd142a0f36 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:22:06.453158 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-9ed40b1f-2b11-47bc-858d-fdd117855533 req-40538c2e-4e4f-48ba-bad0-a0cd142a0f36 service nova] Creating event network-changed:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:22:06.458859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-9ed40b1f-2b11-47bc-858d-fdd117855533 req-40538c2e-4e4f-48ba-bad0-a0cd142a0f36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Jan 28 08:22:06.459758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 673/1324] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:23:53.922297 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:23:53.922987 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:23:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:24:20.401034 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 08:24:20.404524 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:24:20.405043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:20.410805 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:20.415353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:20.415353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:20.415353 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:20.437361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lazy-loading 'flavor' on Instance uuid 07dad479-46b4-4baa-b8a4-114798e7af3c {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:24:20.723610 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c51f132a-0957-4cd6-9f41-d29a2f252afd tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "POST /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c/action" status: 202 len: 0 microversion: 2.1 time: 0.324334 Jan 28 08:24:20.724111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 652/1325] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:24:20 2022] POST /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:24:20.730969 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 08:24:20.735140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:20.735961 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:20.741927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:20.742380 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:20.743160 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:20.743620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:20.881684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:20.889510 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a4b3a19f-6e3d-4c22-aaa4-2d8ba65a36e7 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.160880 Jan 28 08:24:20.890093 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 674/1326] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:20 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:21.908510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:21.909212 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:21.916976 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:21.917431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:21.918238 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:21.918671 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:21.922010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49062. Jan 28 08:24:22.047835 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:22.055099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6b851ecf-f0d5-4451-85f7-99b355d7b420 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.151625 Jan 28 08:24:22.055701 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 653/1327] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:21 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:23.071947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:23.072553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:23.079839 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:23.080296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:23.081075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:23.081514 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:23.087051 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49066. Jan 28 08:24:23.211385 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:23.219185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-7b1cc4df-8f5f-4452-95dd-fbb80bbc9a6b tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.150908 Jan 28 08:24:23.219771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 675/1328] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:23 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:24.236206 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:24.236818 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:24.243076 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:24.243571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:24.244830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:24.245260 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:24.376167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:24.383396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ac182d95-062a-414e-8069-cf90c3e5a8be tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.150840 Jan 28 08:24:24.383969 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 654/1329] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:24 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:25.401483 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:25.402604 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:25.408879 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:25.409334 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:25.410107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:25.410544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:25.545903 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:25.553155 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2eacef46-6acf-4222-9c32-f53193f2c0a4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.155353 Jan 28 08:24:25.553752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 676/1330] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:25 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:26.569735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:26.570398 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:26.576928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:26.577330 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:26.578105 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:26.578548 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:26.712829 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:26.720177 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e10e72a0-3f04-4728-b84a-74afb19ee589 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.154221 Jan 28 08:24:26.720743 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 655/1331] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:26 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:27.737095 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:27.737645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:27.743873 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:27.744331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:27.745104 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:27.746076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:27.870291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:27.878111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1b0c41a7-1c9c-457c-9dba-4e0797c31cc4 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.144788 Jan 28 08:24:27.878680 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 677/1332] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:27 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:24:28.895591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:28.896208 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:28.902428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:28.902870 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:28.903670 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:28.904104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:29.029340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:29.036528 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fd74c437-32bf-46f9-802c-42c4a337f2b9 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.144581 Jan 28 08:24:29.037089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 656/1333] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:28 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:30.054114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:30.054724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:30.061469 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:30.061918 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:30.062684 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:30.063118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:30.195401 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:30.203277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-ffacab9e-e211-4884-9b4c-209258313e00 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.152896 Jan 28 08:24:30.203823 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 678/1334] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:30 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:31.220833 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:31.221585 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:31.227812 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:31.228308 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:31.229094 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:31.229537 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:31.420328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:31.427595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-71a016e1-4c9f-4dea-91b8-8a5c9568f186 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.210499 Jan 28 08:24:31.428169 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 657/1335] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:31 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:31.708584 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:24:31.709125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:24:32.445152 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:32.445771 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:32.452108 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:32.452624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:32.453462 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:32.453903 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:32.583880 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:32.591858 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-73f4825a-1131-4098-b3e8-776f86a55579 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.150447 Jan 28 08:24:32.592427 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 679/1336] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:32 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:33.608843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:33.609596 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:33.616088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:33.616536 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:33.617335 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:33.617766 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:33.844178 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:33.852476 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0f61f617-9349-4ff4-8bef-ff157e873809 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.247311 Jan 28 08:24:33.862497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 658/1337] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:33 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:33.947804 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:24:33.948010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:24:34.869353 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:34.869986 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:34.876717 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:34.877174 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:34.877951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:34.878393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:35.007980 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:35.015487 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-1b1d11b7-743a-4a3e-8add-cecc52abc1d2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1509 microversion: 2.1 time: 0.149794 Jan 28 08:24:35.016052 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 680/1338] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:34 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:35.031610 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:24:35.032188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:35.038417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:35.044389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:35.044389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:35.044389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:35.224974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a421d183-ae01-475e-a210-ad9946ff3048 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "POST /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c/action" status: 202 len: 0 microversion: 2.1 time: 0.196867 Jan 28 08:24:35.225689 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 659/1339] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jan 28 08:24:35 2022] POST /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:24:35.234098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:35.234714 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:35.240622 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:35.241076 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:35.241859 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:35.242296 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:35.370774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:35.378187 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-103beed8-2daa-495a-b9a2-680f5c59606f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1517 microversion: 2.1 time: 0.148357 Jan 28 08:24:35.378754 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 681/1340] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:35 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:24:36.395199 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:36.395844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:36.402194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:36.402645 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:36.403455 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:36.403925 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:36.535724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:36.543123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3b3b1975-5523-4ef3-988b-1ab9fe0d7f0f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1519 microversion: 2.1 time: 0.152170 Jan 28 08:24:36.546414 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 660/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:36 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:37.561072 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:37.561656 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:37.567877 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:37.568329 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:37.569102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:37.569530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:37.697113 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:37.704435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-218b6013-dc5e-433f-b46f-9838aafd6732 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.147105 Jan 28 08:24:37.705003 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 682/1342] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:37 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:38.514237 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-dc7d30ef-6922-4f8b-ac63-8216d17dadb4 req-ac935bd8-87b6-43d5-b41a-4b8e419e53ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "name": "network-vif-unplugged", "status": "completed", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:24:38.515872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:24:38.515872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:24:38.522578 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-dc7d30ef-6922-4f8b-ac63-8216d17dadb4 req-ac935bd8-87b6-43d5-b41a-4b8e419e53ac service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:38.522996 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-dc7d30ef-6922-4f8b-ac63-8216d17dadb4 req-ac935bd8-87b6-43d5-b41a-4b8e419e53ac service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:38.533440 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-dc7d30ef-6922-4f8b-ac63-8216d17dadb4 req-ac935bd8-87b6-43d5-b41a-4b8e419e53ac service nova] Creating event network-vif-unplugged:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:24:38.538612 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-dc7d30ef-6922-4f8b-ac63-8216d17dadb4 req-ac935bd8-87b6-43d5-b41a-4b8e419e53ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086315 Jan 28 08:24:38.539194 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 661/1343] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:24:38.721107 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:38.721722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:38.728001 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:38.728455 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:38.729224 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:38.730171 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:38.858811 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:38.866102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-8dc0ab97-4068-405a-801a-22adca9ffe10 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.148602 Jan 28 08:24:38.866687 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 683/1344] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:38 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:39.884485 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:39.885227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:39.891954 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:39.892409 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:39.893183 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:39.893623 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:40.022856 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:40.030251 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0eea6cd9-c106-4eaf-bc4c-4bc87983002d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.150308 Jan 28 08:24:40.030820 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 662/1345] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:39 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:41.046940 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:41.047593 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:41.053837 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:41.054294 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:41.055065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:41.055537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:41.180330 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:41.188103 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fa4ba941-afff-413f-bfd9-951a546693bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.144826 Jan 28 08:24:41.188665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 684/1346] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:41 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:42.205029 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:42.205683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:42.211985 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:42.212438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:42.213216 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:42.213658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:42.345832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:42.353067 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-15ea530e-9d6d-4b2b-a935-1e5a30b9ab74 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.151645 Jan 28 08:24:42.353628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 663/1347] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:42 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:43.370735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:43.371372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:43.377569 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:43.378012 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:43.378774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:43.379197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:43.508274 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:43.516089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-0363576e-15c3-43f2-bace-36e0d7168fbf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.149448 Jan 28 08:24:43.516660 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 685/1348] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:43 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:44.533074 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:44.533676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:44.539869 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:44.540311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:44.541068 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:44.541502 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:44.667045 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:44.674341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c5a7bcb9-70d2-48ac-a3e3-2a081b0d68f2 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.144976 Jan 28 08:24:44.674908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 664/1349] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:44 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:45.695396 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:45.696013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:45.702211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:45.702665 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:45.703588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:45.704025 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:45.831951 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:45.839871 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2de059ea-0cfb-4833-bb2a-37a164df1b0d tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1575 microversion: 2.1 time: 0.148149 Jan 28 08:24:45.840446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 686/1350] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:45 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:46.856851 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:24:46.857470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:24:46.863771 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:46.864227 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:46.865002 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:46.865441 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:46.996150 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:24:47.003568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-01af0500-67f3-41ed-ac2e-2e98cc36f678 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1562 microversion: 2.1 time: 0.150420 Jan 28 08:24:47.004135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 665/1351] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:24:46 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:24:48.542420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "name": "network-vif-plugged", "status": "completed", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:24:48.546701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:24:48.546701 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:24:48.551276 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:24:48.551767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:24:48.562090 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] Creating event network-vif-plugged:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:24:48.565612 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: ERROR oslo.messaging._drivers.impl_rabbit [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] [4b1e515a-9fd2-4d04-bd5e-663379a8131c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 08:24:49.572713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] [4b1e515a-9fd2-4d04-bd5e-663379a8131c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49158. Jan 28 08:24:49.576317 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-30bde702-b8b4-4e5b-9451-f7e32043a404 req-9820966c-bc57-4b89-b725-14db0d258415 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.037747 Jan 28 08:24:49.576911 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 687/1352] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:26:16.807123 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:16.807678 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:16.814559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:16.815019 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:16.815841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:16.816280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:16.843564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:26:16.869235 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-7398d4fc-7e0d-4260-824c-38a7963ee21b req-8b2207cc-ef4b-4e72-bc71-0dcb78d1e3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:26:16.871923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:26:16.871923 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:26:16.879298 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-7398d4fc-7e0d-4260-824c-38a7963ee21b req-8b2207cc-ef4b-4e72-bc71-0dcb78d1e3f3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:16.879758 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-7398d4fc-7e0d-4260-824c-38a7963ee21b req-8b2207cc-ef4b-4e72-bc71-0dcb78d1e3f3 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:16.891544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-7398d4fc-7e0d-4260-824c-38a7963ee21b req-8b2207cc-ef4b-4e72-bc71-0dcb78d1e3f3 service nova] Creating event network-changed:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:26:16.896924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-7398d4fc-7e0d-4260-824c-38a7963ee21b req-8b2207cc-ef4b-4e72-bc71-0dcb78d1e3f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091843 Jan 28 08:26:16.897518 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 688/1353] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:26:17.096880 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8048997e-e12a-4948-9f5e-b69b21eb0960 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 204 len: 0 microversion: 2.1 time: 0.293975 Jan 28 08:26:17.101122 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 666/1354] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:26:16 2022] DELETE /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:26:17.107303 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:17.108323 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:17.116925 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:17.117454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:17.118269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:17.118698 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:17.262393 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:26:17.270471 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-d33034d8-89b2-4e12-88c6-cbe542c26a51 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1568 microversion: 2.1 time: 0.167954 Jan 28 08:26:17.280996 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 689/1355] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:26:17 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:26:18.288452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:18.289151 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:18.295563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:18.296015 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:18.296787 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:18.297223 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:18.431078 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:26:18.439084 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ca749b16-2824-43a0-b0e9-e8e1aae163bf tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1449 microversion: 2.1 time: 0.154611 Jan 28 08:26:18.439676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 667/1356] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:26:18 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:26:19.374489 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-eb17a343-c0bc-478d-81c7-d2a5e5bfb4fa req-bb6c7d99-dbc1-4d58-a95b-a43027276884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dad479-46b4-4baa-b8a4-114798e7af3c", "name": "network-vif-deleted", "tag": "30a04bf6-9112-4c86-af3f-b1b787e0c31a"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:26:19.378813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:26:19.378813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:26:19.383704 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-eb17a343-c0bc-478d-81c7-d2a5e5bfb4fa req-bb6c7d99-dbc1-4d58-a95b-a43027276884 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:19.384150 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-eb17a343-c0bc-478d-81c7-d2a5e5bfb4fa req-bb6c7d99-dbc1-4d58-a95b-a43027276884 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:19.398641 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-eb17a343-c0bc-478d-81c7-d2a5e5bfb4fa req-bb6c7d99-dbc1-4d58-a95b-a43027276884 service nova] Creating event network-vif-deleted:30a04bf6-9112-4c86-af3f-b1b787e0c31a for instance 07dad479-46b4-4baa-b8a4-114798e7af3c on hv-cinder-80403 Jan 28 08:26:19.405537 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-eb17a343-c0bc-478d-81c7-d2a5e5bfb4fa req-bb6c7d99-dbc1-4d58-a95b-a43027276884 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086965 Jan 28 08:26:19.406128 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 690/1357] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:26:19.456311 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:19.456926 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:19.463102 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:19.463621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:19.464393 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:19.465462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:19.528161 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:26:19.535499 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-358b55b6-d723-4a19-b531-abf3f0e9a047 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1381 microversion: 2.1 time: 0.082850 Jan 28 08:26:19.536062 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 668/1358] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:26:19 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:26:20.553516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:20.554262 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:20.560817 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:20.561269 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:20.562048 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:20.562482 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:20.594875 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:20.595359 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:20.595810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.objects.instance [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lazy-loading 'fault' on Instance uuid 07dad479-46b4-4baa-b8a4-114798e7af3c {{(pid=116947) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:26:20.635134 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1f91a47f18495c9bc348f97b8875fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac325dcba6fe455e8a46e1a80548d4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:26:20.643237 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bf4d840b-5ef2-4fb6-a702-43ac52a9b481 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 200 len: 1224 microversion: 2.1 time: 0.094110 Jan 28 08:26:20.643829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 691/1359] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:26:20 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:26:21.703990 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:21.704603 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] [instance: 07dad479-46b4-4baa-b8a4-114798e7af3c] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:26:21.710331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:21.710780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:21.711598 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:26:21.712032 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:26:21.725422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] HTTP exception thrown: Instance 07dad479-46b4-4baa-b8a4-114798e7af3c could not be found. Jan 28 08:26:21.725996 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Returning 404 to user: Instance 07dad479-46b4-4baa-b8a4-114798e7af3c could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:26:21.726793 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0f6bbd0d-674f-4b3a-bed8-5ab840b58073 tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c" status: 404 len: 111 microversion: 2.1 time: 0.070400 Jan 28 08:26:21.727337 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 669/1360] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:26:21 2022] GET /compute/v2.1/servers/07dad479-46b4-4baa-b8a4-114798e7af3c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:26:21.936706 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-fe1a467f-689b-4d85-becb-ec15e98e758f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] Calling method '.version_select at 0x7f34741cdd30>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:26:22.011199 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-fe1a467f-689b-4d85-becb-ec15e98e758f tempest-TestShelveInstance-503752966 tempest-TestShelveInstance-503752966-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-817943199" status: 202 len: 0 microversion: 2.1 time: 0.078540 Jan 28 08:26:22.012447 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 692/1361] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jan 28 08:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-817943199 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:26:22.149704 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:26:22.149899 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:26:43.564647 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Action: 'create', calling method: .version_select at 0x7f346f708b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-679594344"}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:26:43.578400 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:26:43.582377 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for user fa5f5eca673d4ee3b25d3347b1cd35ab and project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:26:44.032111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:26:44.036243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for user fa5f5eca673d4ee3b25d3347b1cd35ab and project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'key_pairs'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:26:44.050676 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ce464788-250f-4fda-9522-5f0541416b49 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.668624 Jan 28 08:26:44.051310 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 670/1362] 10.222.0.42 () {60 vars in 1157 bytes} [Fri Jan 28 08:26:43 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:06.168013 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1288709987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679594344", "security_groups": [{"name": "tempest-secgroup-smoke-654499578"}], "block_device_mapping_v2": [{"uuid": "115e37f4-e0fc-424e-9448-8ced5129b7f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1715bbb6-ade5-4349-95f5-ff6ef835184c"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:27:06.373139 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] validate_networks() for [('1715bbb6-ade5-4349-95f5-ff6ef835184c', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:27:06.804529 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:27:06.804947 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:27:06.805409 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:27:06.805810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:27:06.806216 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:27:06.814627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:06.815065 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:06.815899 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:06.816328 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:06.832645 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:27:06.836556 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for user fa5f5eca673d4ee3b25d3347b1cd35ab and project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:27:06.889548 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:27:06.891716 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='115e37f4-e0fc-424e-9448-8ced5129b7f2',volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:27:07.222417 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a831ed3c-8439-4b0d-82ab-d55bf1d0babe tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.058690 Jan 28 08:27:07.223377 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 693/1363] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:27:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:27:07.233361 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-9a6efc61-d70a-499c-8157-33da8af1581f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:07.233973 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-9a6efc61-d70a-499c-8157-33da8af1581f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:07.341354 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-9a6efc61-d70a-499c-8157-33da8af1581f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:07.349162 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-9a6efc61-d70a-499c-8157-33da8af1581f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1094 microversion: 2.1 time: 0.119954 Jan 28 08:27:07.349736 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 671/1364] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:07 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:08.366572 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:08.367200 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:08.373087 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:08.373532 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:08.374293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:08.374725 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:08.437511 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:08.444840 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f0ad900e-c8d0-49df-8e1f-f13f1abfd29b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1144 microversion: 2.1 time: 0.082516 Jan 28 08:27:08.445446 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 694/1365] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:08 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:09.460740 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:09.461474 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:09.467942 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:09.468392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:09.469180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:09.469678 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:09.543628 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:09.552710 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0f8c4a15-6339-45ba-964c-f9adbd633f8d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1200 microversion: 2.1 time: 0.095711 Jan 28 08:27:09.553295 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 672/1366] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:09 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:10.570204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:10.570863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:10.577106 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:10.577563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:10.578331 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:10.578767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:10.716851 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:10.724719 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-353c7343-7f12-46a8-afeb-850e5bef7c46 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1277 microversion: 2.1 time: 0.158099 Jan 28 08:27:10.725445 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 695/1367] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:10 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:10.987289 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-ccaac271-eead-4871-b74c-2da7e55a883a req-966e44c5-a41a-4542-bf44-2018dc6bdb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdb13bf-0bcf-46ff-a7b3-3bef78918b61", "tag": "28e7e7c4-fc63-441f-9353-475f114340c8"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:27:10.988727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:27:10.988727 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:27:10.996420 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-ccaac271-eead-4871-b74c-2da7e55a883a req-966e44c5-a41a-4542-bf44-2018dc6bdb1c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:10.996865 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-ccaac271-eead-4871-b74c-2da7e55a883a req-966e44c5-a41a-4542-bf44-2018dc6bdb1c service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:11.009836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-ccaac271-eead-4871-b74c-2da7e55a883a req-966e44c5-a41a-4542-bf44-2018dc6bdb1c service nova] Creating event network-changed:28e7e7c4-fc63-441f-9353-475f114340c8 for instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 on hv-cinder-80403 Jan 28 08:27:11.015110 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-ccaac271-eead-4871-b74c-2da7e55a883a req-966e44c5-a41a-4542-bf44-2018dc6bdb1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032128 Jan 28 08:27:11.016179 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 673/1368] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:27:11.741679 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:11.742293 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:11.748564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:11.749021 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:11.749795 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:11.750232 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:11.876939 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:11.884347 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-bca757ac-30a6-4dcf-b9d5-809c2ceca2b7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.146384 Jan 28 08:27:11.884915 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 696/1369] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:11 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:12.902106 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:12.902843 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:12.909863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:12.910318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:12.911095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:12.911570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:13.041769 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:13.049012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-fa778913-543a-4e11-a2fd-c218011f9409 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.150955 Jan 28 08:27:13.049591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 674/1370] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:12 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:14.065419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:14.066102 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:14.072647 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:14.073098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:14.073870 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:14.074308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:14.212549 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:14.219967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-53485c21-4976-4637-be1b-ad8335ad6163 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.158248 Jan 28 08:27:14.220536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 697/1371] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:14 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:15.237589 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:15.238786 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:15.245512 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:15.245968 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:15.246759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:15.247201 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:15.388960 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:15.396483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aee51df6-151b-450f-a6e0-2e98b19aff10 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.163332 Jan 28 08:27:15.397054 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 675/1372] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:15 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:16.414779 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:16.415419 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:16.421728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:16.422234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:16.423002 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:16.423473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:16.549588 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:16.557391 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-a6c43033-b290-40bb-9603-3f776abdc541 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.146301 Jan 28 08:27:16.557953 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 698/1373] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:16 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:17.574049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:17.574591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:17.580917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:17.581915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:17.582687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:17.583124 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:17.711874 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:17.719098 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-800bd2a8-e64e-487b-8b4c-5fb481e9643f tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.148849 Jan 28 08:27:17.719698 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 676/1374] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:17 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:18.736349 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:18.736890 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:18.743420 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:18.743874 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:18.744677 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:18.745114 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:18.873869 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:18.881822 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-29b5cf75-47af-4aea-a244-2a79b0ad7cab tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.149195 Jan 28 08:27:18.882387 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 699/1375] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:18 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:19.898332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:19.898934 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:19.905667 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:19.906116 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:19.906884 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:19.907338 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:20.032431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:20.040280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-537255d5-a3cb-4e09-8bdc-5f329d0d9ab5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.146329 Jan 28 08:27:20.040846 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 677/1376] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:19 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:21.057047 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:21.057664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:21.063943 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:21.064399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:21.065211 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:21.065649 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:21.193237 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:21.200965 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f7f6ccd2-a9b4-4fc8-a22e-a3b927a5eed3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.147586 Jan 28 08:27:21.201530 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 700/1377] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:21 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:21.265522 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-f4526bd9-14ef-417a-8fbb-4f84a71c34b0 req-938cc8b7-26c4-4da7-862a-52530ef59c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdb13bf-0bcf-46ff-a7b3-3bef78918b61", "name": "network-vif-plugged", "status": "completed", "tag": "28e7e7c4-fc63-441f-9353-475f114340c8"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:27:21.267104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:27:21.267104 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:27:21.275218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-f4526bd9-14ef-417a-8fbb-4f84a71c34b0 req-938cc8b7-26c4-4da7-862a-52530ef59c48 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:21.280142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-f4526bd9-14ef-417a-8fbb-4f84a71c34b0 req-938cc8b7-26c4-4da7-862a-52530ef59c48 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:21.286882 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-f4526bd9-14ef-417a-8fbb-4f84a71c34b0 req-938cc8b7-26c4-4da7-862a-52530ef59c48 service nova] Creating event network-vif-plugged:28e7e7c4-fc63-441f-9353-475f114340c8 for instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 on hv-cinder-80403 Jan 28 08:27:21.291982 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-f4526bd9-14ef-417a-8fbb-4f84a71c34b0 req-938cc8b7-26c4-4da7-862a-52530ef59c48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030139 Jan 28 08:27:21.292564 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 678/1378] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:27:22.217732 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:22.218345 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:22.224664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:22.225125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:22.225894 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:22.226327 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:22.357388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:22.365308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6a3bf299-0f0b-4e33-a5ef-e9f1de383a0e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1265 microversion: 2.1 time: 0.151166 Jan 28 08:27:22.365809 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 701/1379] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:22 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:23.384559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:23.385267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:23.391497 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:23.391952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:23.392724 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:23.393165 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:23.521475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:23.528887 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4473a17a-49c2-4c22-83a0-ec247e776177 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1453 microversion: 2.1 time: 0.148338 Jan 28 08:27:23.529450 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 679/1380] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:23 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:23.544388 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:27:23.544999 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:27:23.551369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:23.551825 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:23.552586 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:23.553019 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:23.676952 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:27:23.684087 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-955bb5d7-bd1f-4779-a846-64bae9c59ec0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1453 microversion: 2.1 time: 0.143277 Jan 28 08:27:23.684643 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 702/1381] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:27:23 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:27:25.800039 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-fed9d2f1-1b96-4a7a-a418-05d9b99fd8c9 req-3ada78fd-fc1b-442a-ad46-769544695f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdb13bf-0bcf-46ff-a7b3-3bef78918b61", "tag": "28e7e7c4-fc63-441f-9353-475f114340c8"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:27:25.801760 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:27:25.801760 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:27:25.808980 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-fed9d2f1-1b96-4a7a-a418-05d9b99fd8c9 req-3ada78fd-fc1b-442a-ad46-769544695f49 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:27:25.810056 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-fed9d2f1-1b96-4a7a-a418-05d9b99fd8c9 req-3ada78fd-fc1b-442a-ad46-769544695f49 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:27:25.820179 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-fed9d2f1-1b96-4a7a-a418-05d9b99fd8c9 req-3ada78fd-fc1b-442a-ad46-769544695f49 service nova] Creating event network-changed:28e7e7c4-fc63-441f-9353-475f114340c8 for instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 on hv-cinder-80403 Jan 28 08:27:25.825241 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-fed9d2f1-1b96-4a7a-a418-05d9b99fd8c9 req-3ada78fd-fc1b-442a-ad46-769544695f49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028745 Jan 28 08:27:25.826092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 680/1382] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:27:53.956952 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:27:53.957630 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:28:53.931917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:28:53.932488 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:28:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:29:31.718161 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:29:31.718917 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:29:39.624910 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 08:29:39.628399 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:39.628903 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:39.634865 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:39.635354 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:39.636127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:39.636563 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:39.661104 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Going to try to terminate instance {{(pid=116947) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:29:39.968147 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14c4c5f9-70a6-43e5-8789-aa769342dca4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 204 len: 0 microversion: 2.1 time: 0.344981 Jan 28 08:29:39.969238 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 703/1383] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:29:39 2022] DELETE /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:29:39.975461 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 08:29:39.979283 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:39.979991 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:39.986135 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:39.986592 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:39.987392 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:39.987840 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:40.115318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:40.122730 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3fc07385-f099-433c-8610-acd505087fcf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1578 microversion: 2.1 time: 0.149092 Jan 28 08:29:40.123571 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 681/1384] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:39 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:41.140624 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:41.141326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:41.148906 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:41.149361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:41.150141 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:41.150580 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:41.156533 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49560. Jan 28 08:29:41.285170 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:41.292590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e1d3dc3b-42fc-4d63-bd94-b81c1eae47b1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1578 microversion: 2.1 time: 0.156031 Jan 28 08:29:41.293157 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 704/1385] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:41 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:42.157838 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:29:42.158380 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:29:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:29:42.309794 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:42.310405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:42.318133 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:42.318594 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:42.319406 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:42.319836 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:42.345303 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49574. Jan 28 08:29:42.404262 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:42.412308 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5ef3c860-279c-4a0c-9e52-9b1b565fa080 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1511 microversion: 2.1 time: 0.106288 Jan 28 08:29:42.413193 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 682/1386] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:42 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:42.620229 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-d0bca5a5-bc87-459f-b866-9c1aada84ca2 req-40d979e0-8c9c-49ef-9e4d-a10471248f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdb13bf-0bcf-46ff-a7b3-3bef78918b61", "name": "network-vif-deleted", "tag": "28e7e7c4-fc63-441f-9353-475f114340c8"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:29:42.622041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:29:42.622041 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:29:42.630322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d0bca5a5-bc87-459f-b866-9c1aada84ca2 req-40d979e0-8c9c-49ef-9e4d-a10471248f15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:42.636607 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d0bca5a5-bc87-459f-b866-9c1aada84ca2 req-40d979e0-8c9c-49ef-9e4d-a10471248f15 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:42.642306 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-d0bca5a5-bc87-459f-b866-9c1aada84ca2 req-40d979e0-8c9c-49ef-9e4d-a10471248f15 service nova] Creating event network-vif-deleted:28e7e7c4-fc63-441f-9353-475f114340c8 for instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 on hv-cinder-80403 Jan 28 08:29:42.647372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-d0bca5a5-bc87-459f-b866-9c1aada84ca2 req-40d979e0-8c9c-49ef-9e4d-a10471248f15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030950 Jan 28 08:29:42.647957 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 705/1387] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:29:43.429331 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:43.430009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:43.436543 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:43.436986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:43.437765 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:43.438240 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:43.473088 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:43.473539 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:43.474009 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.objects.instance [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lazy-loading 'fault' on Instance uuid 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 {{(pid=116948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 08:29:43.513387 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:43.521171 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-591f50b8-a1c9-4ef9-a70b-00e0d9b30467 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 200 len: 1230 microversion: 2.1 time: 0.095571 Jan 28 08:29:43.522146 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 683/1388] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:43 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:44.539885 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:44.540512 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:44.547089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:44.547581 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:44.548354 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:44.548810 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:44.563461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] HTTP exception thrown: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. Jan 28 08:29:44.564043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Returning 404 to user: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:29:44.564847 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-cdfa4a92-0f45-40f5-9aea-49a871a02611 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 404 len: 111 microversion: 2.1 time: 0.029598 Jan 28 08:29:44.565365 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 706/1389] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:44 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:29:44.609690 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2051415976", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679594344", "security_groups": [{"name": "tempest-secgroup-smoke-654499578"}], "block_device_mapping_v2": [{"uuid": "115e37f4-e0fc-424e-9448-8ced5129b7f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1715bbb6-ade5-4349-95f5-ff6ef835184c"}]}} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:29:44.712932 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.network.neutron [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] validate_networks() for [('1715bbb6-ade5-4349-95f5-ff6ef835184c', None, None, None, None, None)] {{(pid=116948) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:29:45.102180 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:29:45.102604 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image limits 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:29:45.103082 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:29:45.103531 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image pref 0:0:0 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:29:45.103948 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.virt.hardware [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:29:45.113176 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:45.113655 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:45.114470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:45.114906 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:45.131139 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:29:45.135483 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.quota [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for user fa5f5eca673d4ee3b25d3347b1cd35ab and project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:29:45.188487 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Going to run 1 instances... {{(pid=116948) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:29:45.190591 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='115e37f4-e0fc-424e-9448-8ced5129b7f2',volume_size=None,volume_type=None)] {{(pid=116948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:29:45.518716 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-aef2d9c0-cc86-4270-9a8a-7d30ee01aaaf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.913149 Jan 28 08:29:45.523306 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 684/1390] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:29:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:29:45.529078 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-80936993-a794-469f-930b-17acac73a287 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:45.529694 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-80936993-a794-469f-930b-17acac73a287 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:45.581752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-80936993-a794-469f-930b-17acac73a287 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:45.588408 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-80936993-a794-469f-930b-17acac73a287 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1094 microversion: 2.1 time: 0.062925 Jan 28 08:29:45.588966 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 707/1391] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:45 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:29:46.605559 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:46.606110 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:46.612595 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:46.613035 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:46.613798 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:46.614226 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:46.672366 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:46.679548 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a08e0522-18d5-4f47-b78b-51936e1e7ee8 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1144 microversion: 2.1 time: 0.078155 Jan 28 08:29:46.680092 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 685/1392] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:46 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 08:29:47.695180 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:47.695813 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:47.703226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:47.703720 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:47.704516 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:47.704956 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:47.768366 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:47.778179 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-14979c0c-30b1-47ee-88bf-58835a66b68b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1210 microversion: 2.1 time: 0.086588 Jan 28 08:29:47.785044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 708/1393] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:47 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:48.795341 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:48.795895 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:48.802299 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:48.802755 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:48.803566 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:48.804005 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:49.008696 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:49.015964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-e2409c1c-2f64-4159-8161-af3004e52b5e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.224489 Jan 28 08:29:49.016518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 686/1394] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:48 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:49.382975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-519beddf-d31f-4cce-9a05-69be38d69a94 req-f3044be3-7015-4c1e-8422-35c57748b1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20cf233-0ce4-4a7d-bce8-f589df779855", "tag": "1824b52c-794a-4b00-8290-e4a96366bea4"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:29:49.386204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:29:49.386204 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:29:49.397315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-519beddf-d31f-4cce-9a05-69be38d69a94 req-f3044be3-7015-4c1e-8422-35c57748b1c7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:49.397315 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-519beddf-d31f-4cce-9a05-69be38d69a94 req-f3044be3-7015-4c1e-8422-35c57748b1c7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:49.410737 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-519beddf-d31f-4cce-9a05-69be38d69a94 req-f3044be3-7015-4c1e-8422-35c57748b1c7 service nova] Creating event network-changed:1824b52c-794a-4b00-8290-e4a96366bea4 for instance f20cf233-0ce4-4a7d-bce8-f589df779855 on hv-cinder-80403 Jan 28 08:29:49.416638 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-519beddf-d31f-4cce-9a05-69be38d69a94 req-f3044be3-7015-4c1e-8422-35c57748b1c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041515 Jan 28 08:29:49.419526 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 709/1395] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:29:50.031666 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:50.032274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:50.038622 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:50.039079 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:50.039896 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:50.040335 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:50.170121 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:50.177510 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-bbc531a7-34cd-40d6-a47b-3d65d90bfe3b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.149551 Jan 28 08:29:50.178073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 687/1396] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:50 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:51.196218 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:51.197308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:51.207291 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:51.207967 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:51.209127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:51.209784 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:51.346461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:51.353735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9dc1c44c-7e9a-450a-8f38-3d6782af86bf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.163537 Jan 28 08:29:51.354292 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 710/1397] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:51 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:52.370066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:52.370683 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:52.377213 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:52.377658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:52.378430 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:52.378863 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:52.506203 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:52.513478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-8a311072-0994-40d4-b652-bc44e2de641a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.147048 Jan 28 08:29:52.514049 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 688/1398] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:52 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:53.529974 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:53.530575 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:53.536888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:53.537340 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:53.538118 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:53.538558 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:53.667637 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:53.675369 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9fb4eccb-8ad2-4fe1-8804-0b3538d7236d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.149094 Jan 28 08:29:53.675927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 711/1399] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:53 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:54.692489 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:54.693111 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:54.699423 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:54.699881 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:54.700658 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:54.701099 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:54.833417 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:54.840651 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-98ecb47d-0b88-4377-80f3-2752d2cbd86e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.151830 Jan 28 08:29:54.841215 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 689/1400] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:54 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:55.857505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:55.858111 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:55.864300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:55.864752 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:55.865519 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:55.865946 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:55.990858 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:55.998351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-c57ad7a3-9961-4670-a639-b8815be82cb5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.144489 Jan 28 08:29:55.998912 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 712/1401] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:55 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:57.014972 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:57.015605 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:57.021861 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:57.022314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:57.023089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:57.023568 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:57.149302 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:57.157163 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-86ed8823-49e0-4110-8946-74c7c55bfbba tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.145925 Jan 28 08:29:57.157731 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 690/1402] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:57 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:58.174091 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:58.174735 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:58.180970 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:58.181472 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:58.182201 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:58.182644 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:58.316412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:58.326101 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-3f9f6c02-d5f1-4d0b-9750-b5f749576be3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.156122 Jan 28 08:29:58.326678 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 713/1403] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:58 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:29:59.341637 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:29:59.342243 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:29:59.348962 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:59.349405 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:59.350167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:29:59.350598 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:29:59.477036 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:29:59.484280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-eba785a7-7622-480c-9a49-6ab84472f2a3 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.146286 Jan 28 08:29:59.484844 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 691/1404] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:29:59 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:30:00.141223 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-ca88ea00-54d8-42ff-853c-a29659ada6c6 req-476ae908-7954-4b9b-bace-ef891b3dae42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20cf233-0ce4-4a7d-bce8-f589df779855", "name": "network-vif-plugged", "status": "completed", "tag": "1824b52c-794a-4b00-8290-e4a96366bea4"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:30:00.142791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:30:00.142791 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:30:00.149459 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ca88ea00-54d8-42ff-853c-a29659ada6c6 req-476ae908-7954-4b9b-bace-ef891b3dae42 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:00.149900 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-ca88ea00-54d8-42ff-853c-a29659ada6c6 req-476ae908-7954-4b9b-bace-ef891b3dae42 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:00.162350 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-ca88ea00-54d8-42ff-853c-a29659ada6c6 req-476ae908-7954-4b9b-bace-ef891b3dae42 service nova] Creating event network-vif-plugged:1824b52c-794a-4b00-8290-e4a96366bea4 for instance f20cf233-0ce4-4a7d-bce8-f589df779855 on hv-cinder-80403 Jan 28 08:30:00.166600 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-ca88ea00-54d8-42ff-853c-a29659ada6c6 req-476ae908-7954-4b9b-bace-ef891b3dae42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086485 Jan 28 08:30:00.167185 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 714/1405] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:30:00.501886 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:30:00.502517 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:30:00.509323 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:00.509783 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:00.510572 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:00.511012 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:00.638862 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:30:00.646075 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-0101f4de-0233-4db7-b004-b4612c689a4c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.148880 Jan 28 08:30:00.646640 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 692/1406] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:30:00 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:30:01.664289 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:30:01.664927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:30:01.671326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:01.671778 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:01.672542 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:01.672977 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:01.801485 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:30:01.808708 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-dff1865e-a566-46b9-8f76-08d1b0627000 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1265 microversion: 2.1 time: 0.148889 Jan 28 08:30:01.809243 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 715/1407] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:30:01 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:30:02.826275 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:30:02.827064 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:30:02.833324 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:02.833780 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:02.834558 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:02.834999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:02.970986 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:30:02.978339 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-4d932630-663f-4328-b62a-070ce16e5a41 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1453 microversion: 2.1 time: 0.155781 Jan 28 08:30:02.978908 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 693/1408] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:30:02 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:30:02.994435 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:30:02.995044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:30:03.001473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:03.001924 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:03.002699 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:03.003131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:03.128553 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:30:03.136213 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-773bc0a1-652a-4e44-8755-36a923f35017 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1453 microversion: 2.1 time: 0.145337 Jan 28 08:30:03.136728 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 716/1409] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:30:02 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:30:05.096442 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-55b67565-c464-459d-9802-990302b2c34e req-beda4e7d-e564-42bc-9ca6-d740bdd885ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20cf233-0ce4-4a7d-bce8-f589df779855", "tag": "1824b52c-794a-4b00-8290-e4a96366bea4"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:30:05.098023 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:30:05.098023 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:30:05.105453 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-55b67565-c464-459d-9802-990302b2c34e req-beda4e7d-e564-42bc-9ca6-d740bdd885ac service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:30:05.105901 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-55b67565-c464-459d-9802-990302b2c34e req-beda4e7d-e564-42bc-9ca6-d740bdd885ac service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:30:05.117089 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-55b67565-c464-459d-9802-990302b2c34e req-beda4e7d-e564-42bc-9ca6-d740bdd885ac service nova] Creating event network-changed:1824b52c-794a-4b00-8290-e4a96366bea4 for instance f20cf233-0ce4-4a7d-bce8-f589df779855 on hv-cinder-80403 Jan 28 08:30:05.122462 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-55b67565-c464-459d-9802-990302b2c34e req-beda4e7d-e564-42bc-9ca6-d740bdd885ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029289 Jan 28 08:30:05.123081 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 694/1410] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:32:07.912543 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1467917610", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679594344", "security_groups": [{"name": "tempest-secgroup-smoke-654499578"}], "block_device_mapping_v2": [{"uuid": "042b145c-d196-4a11-9de4-bf1bcbbeb412", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1715bbb6-ade5-4349-95f5-ff6ef835184c"}]}} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:32:08.076424 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.network.neutron [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] validate_networks() for [('1715bbb6-ade5-4349-95f5-ff6ef835184c', None, None, None, None, None)] {{(pid=116947) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 08:32:08.479108 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 08:32:08.479561 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image limits 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 08:32:08.480037 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Flavor pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 08:32:08.480450 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Image pref 0:0:0 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 08:32:08.480863 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.virt.hardware [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116947) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 08:32:08.489454 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:08.489963 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:08.490702 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:08.491140 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:08.508370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 08:32:08.512871 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.quota [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Getting quotas for user fa5f5eca673d4ee3b25d3347b1cd35ab and project 4ec5fbf3e95e4324800fc5cfe04b6493. Resources: {'cores', 'ram', 'instances'} {{(pid=116947) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 08:32:08.565852 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Going to run 1 instances... {{(pid=116947) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 08:32:08.568127 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='042b145c-d196-4a11-9de4-bf1bcbbeb412',volume_size=None,volume_type=None)] {{(pid=116947) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 08:32:08.846221 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2ada16d4-2d8b-4f74-bc1b-677b86128db4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938265 Jan 28 08:32:08.846849 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 717/1411] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jan 28 08:32:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 08:32:08.856475 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 28 08:32:08.860460 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-be119f18-0f9f-404b-b4bb-77d194158cc4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:08.861167 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-be119f18-0f9f-404b-b4bb-77d194158cc4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:08.963452 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-be119f18-0f9f-404b-b4bb-77d194158cc4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:08.970511 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-be119f18-0f9f-404b-b4bb-77d194158cc4 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1094 microversion: 2.1 time: 0.117470 Jan 28 08:32:08.971157 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 695/1412] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:08 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:09.989081 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:09.989697 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:09.997089 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:09.998423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:09.998423 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:09.998876 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:10.058722 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:10.065938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-33b1a7d6-7770-417c-9083-684563cad57c tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1136 microversion: 2.1 time: 0.081530 Jan 28 08:32:10.066500 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 718/1413] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:09 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:11.086428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:11.087397 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:11.097809 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:11.098348 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:11.099137 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:11.099588 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:11.120443 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] [64a7b29e-33ce-4886-8cd4-ba5da812209c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49760. Jan 28 08:32:11.169317 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:11.176711 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1bcb99e0-3740-436e-9926-942bed846eaa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1210 microversion: 2.1 time: 0.094167 Jan 28 08:32:11.177274 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 696/1414] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:11 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:12.197309 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:12.198188 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:12.205165 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:12.206043 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:12.206832 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:12.207313 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:12.256145 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-d749ddeb-b79d-44db-ac3b-85c917106d1a req-1d961710-070a-425e-aefc-bb251e745009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f24bdb6-a5a0-4996-ac78-b3b943b7c203", "tag": "9b06e465-3a7f-4846-a56a-a4f169a2010c"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:32:12.258642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:32:12.258642 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:32:12.267020 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d749ddeb-b79d-44db-ac3b-85c917106d1a req-1d961710-070a-425e-aefc-bb251e745009 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:12.267631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-d749ddeb-b79d-44db-ac3b-85c917106d1a req-1d961710-070a-425e-aefc-bb251e745009 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:12.281602 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-d749ddeb-b79d-44db-ac3b-85c917106d1a req-1d961710-070a-425e-aefc-bb251e745009 service nova] Creating event network-changed:9b06e465-3a7f-4846-a56a-a4f169a2010c for instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 on hv-cinder-80403 Jan 28 08:32:12.287631 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-d749ddeb-b79d-44db-ac3b-85c917106d1a req-1d961710-070a-425e-aefc-bb251e745009 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125690 Jan 28 08:32:12.289798 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 719/1415] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:32:12.450808 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:12.458340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-5d885df8-a7e6-4ed5-9947-29a58e49ad20 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.268295 Jan 28 08:32:12.458911 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 697/1416] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:12 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:13.476544 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:13.477168 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:13.483755 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:13.484197 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:13.485234 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:13.485662 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:13.612339 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:13.620394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e1033b61-5b98-4fbc-a97e-669ec2e8485a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.147798 Jan 28 08:32:13.620941 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 720/1417] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:13 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:13.939886 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:32:13.940098 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:32:14.637547 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:14.638192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:14.644464 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:14.644919 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:14.645699 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:14.646134 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:14.774185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:14.781470 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-a07f0341-698b-4a18-ab2f-a2d9fd9b8c9b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.148280 Jan 28 08:32:14.782041 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 698/1418] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:14 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:15.798523 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:15.799066 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:15.805394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:15.805845 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:15.806619 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:15.807691 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:15.938774 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:15.945975 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e0bfcfcf-fa08-4f2e-823c-2d41a79c703e tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.151227 Jan 28 08:32:15.946536 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 721/1419] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:15 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:16.963155 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:16.963810 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:16.970127 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:16.970582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:16.971390 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:16.971834 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:17.095776 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:17.108372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3500b864-f035-4d6a-99ad-750dd7cb9dbf tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.143627 Jan 28 08:32:17.108372 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 699/1420] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:16 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:18.120664 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:18.121275 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:18.127481 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:18.127927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:18.128692 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:18.129121 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:18.253938 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:18.261044 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-357fe176-288f-4d26-b06d-2621e99dbaca tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.144863 Jan 28 08:32:18.261589 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 722/1421] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:18 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:19.280271 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:19.281367 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:19.292160 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:19.292617 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:19.293404 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:19.293841 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:19.424767 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:19.432280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-c7159965-7cf2-41e5-8192-1011fd9e1bc0 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.158350 Jan 28 08:32:19.432679 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 700/1422] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:19 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:20.448620 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:20.449936 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:20.456277 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:20.456736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:20.457513 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:20.458038 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:20.588356 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:20.595776 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f719f996-8d3a-4d09-88fc-c213de6976f1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.150853 Jan 28 08:32:20.596343 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 723/1423] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:20 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:21.611950 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:21.612577 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:21.619066 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:21.619557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:21.620332 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:21.620788 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:21.750218 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:21.757431 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-b5bec004-7153-4568-9a75-2b819a302edc tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.149152 Jan 28 08:32:21.757999 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 701/1424] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:21 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:22.773650 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:22.774412 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:22.779557 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [req-17b80dbf-c34d-4066-87d6-12067cceb3b3 req-0ec77160-15a4-4007-bc50-43d20336fdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f24bdb6-a5a0-4996-ac78-b3b943b7c203", "name": "network-vif-plugged", "status": "completed", "tag": "9b06e465-3a7f-4846-a56a-a4f169a2010c"}]} {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:32:22.780861 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:22.781322 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:22.781668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:32:22.781668 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: warnings.warn(msg) Jan 28 08:32:22.782117 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:22.782726 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:22.788872 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-17b80dbf-c34d-4066-87d6-12067cceb3b3 req-0ec77160-15a4-4007-bc50-43d20336fdf7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:22.789328 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [req-17b80dbf-c34d-4066-87d6-12067cceb3b3 req-0ec77160-15a4-4007-bc50-43d20336fdf7 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:22.800369 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.compute.server_external_events [req-17b80dbf-c34d-4066-87d6-12067cceb3b3 req-0ec77160-15a4-4007-bc50-43d20336fdf7 service nova] Creating event network-vif-plugged:9b06e465-3a7f-4846-a56a-a4f169a2010c for instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 on hv-cinder-80403 Jan 28 08:32:22.805600 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [req-17b80dbf-c34d-4066-87d6-12067cceb3b3 req-0ec77160-15a4-4007-bc50-43d20336fdf7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Jan 28 08:32:22.806204 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 702/1425] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:32:22.915652 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:22.924371 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-f38031e9-8104-48f6-bbfc-aefd25aede58 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.154139 Jan 28 08:32:22.924857 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 724/1426] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:22 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:23.942478 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:23.943185 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:23.949864 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:23.950318 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:23.951095 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:23.951563 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:24.091010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:24.098428 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-cccdfb2e-8c95-4700-afbb-842bc3323d2d tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1265 microversion: 2.1 time: 0.160519 Jan 28 08:32:24.099000 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 703/1427] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:23 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:25.116893 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:25.117486 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:25.124505 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:25.124964 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:25.125744 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:25.126184 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:25.255768 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:25.263565 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-9372f9e8-c994-4656-85a7-d370d148419b tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1453 microversion: 2.1 time: 0.150549 Jan 28 08:32:25.264137 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 725/1428] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:25 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:25.278966 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:32:25.279626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:32:25.285817 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:25.286269 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:25.287044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:25.287516 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:25.425174 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:32:25.432546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-f817b57d-c64c-44c8-adfe-ffc32bc7b9c6 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1453 microversion: 2.1 time: 0.157193 Jan 28 08:32:25.433759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 704/1429] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:32:25 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:32:27.611131 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-813e351a-edba-40d9-8bfb-0d7f2d9ea967 req-209d88cc-9033-4e4a-b534-1b11202b5dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f24bdb6-a5a0-4996-ac78-b3b943b7c203", "tag": "9b06e465-3a7f-4846-a56a-a4f169a2010c"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:32:27.612767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:32:27.612767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:32:27.620364 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-813e351a-edba-40d9-8bfb-0d7f2d9ea967 req-209d88cc-9033-4e4a-b534-1b11202b5dc0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:32:27.620812 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-813e351a-edba-40d9-8bfb-0d7f2d9ea967 req-209d88cc-9033-4e4a-b534-1b11202b5dc0 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:32:27.631508 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-813e351a-edba-40d9-8bfb-0d7f2d9ea967 req-209d88cc-9033-4e4a-b534-1b11202b5dc0 service nova] Creating event network-changed:9b06e465-3a7f-4846-a56a-a4f169a2010c for instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 on hv-cinder-80403 Jan 28 08:32:27.636479 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-813e351a-edba-40d9-8bfb-0d7f2d9ea967 req-209d88cc-9033-4e4a-b534-1b11202b5dc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029373 Jan 28 08:32:27.637590 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 726/1430] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:32:53.966607 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:32:53.967209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:33:02.165830 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:33:02.166465 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:33:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:34:17.552267 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:17.552916 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 28 08:34:17.553314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:17.557461 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-2983d2be-9cbe-4ffa-bb83-145220c904c5 req-2c001a73-2d1b-4922-b13d-22892bc26c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f24bdb6-a5a0-4996-ac78-b3b943b7c203", "tag": "9b06e465-3a7f-4846-a56a-a4f169a2010c"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:34:17.558593 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:17.558948 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:34:17.558948 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:34:17.559153 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:17.559816 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:17.560422 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:17.567302 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-2983d2be-9cbe-4ffa-bb83-145220c904c5 req-2c001a73-2d1b-4922-b13d-22892bc26c0b service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:17.567756 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-2983d2be-9cbe-4ffa-bb83-145220c904c5 req-2c001a73-2d1b-4922-b13d-22892bc26c0b service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:17.578576 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-2983d2be-9cbe-4ffa-bb83-145220c904c5 req-2c001a73-2d1b-4922-b13d-22892bc26c0b service nova] Creating event network-changed:9b06e465-3a7f-4846-a56a-a4f169a2010c for instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 on hv-cinder-80403 Jan 28 08:34:17.583992 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-2983d2be-9cbe-4ffa-bb83-145220c904c5 req-2c001a73-2d1b-4922-b13d-22892bc26c0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033667 Jan 28 08:34:17.584799 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 727/1431] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 08:34:17.586562 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:34:17.896491 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-3f65ae88-203f-4eea-9b55-62991b804fd1 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 204 len: 0 microversion: 2.1 time: 0.348558 Jan 28 08:34:17.897508 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 705/1432] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:34:17 2022] DELETE /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:34:17.906352 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:17.907370 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:17.913927 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:17.914492 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:17.915394 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:17.915922 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:18.053305 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:18.060361 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-6ca60f51-6e2f-4cb4-9ee6-e739267a50f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1578 microversion: 2.1 time: 0.158519 Jan 28 08:34:18.060931 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 728/1433] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:17 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:19.078579 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:19.079314 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:19.085681 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:19.086138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:19.086915 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:19.087389 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:19.214170 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:19.221621 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ec1c5011-d9b0-47cb-a03b-33ba75943bfa tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1459 microversion: 2.1 time: 0.147122 Jan 28 08:34:19.222192 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 706/1434] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:19 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1459 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:20.117976 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-11a5b072-14a6-4a08-bef3-32032976d6d0 req-b6cf55d6-41eb-4783-9372-1707efce0493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f24bdb6-a5a0-4996-ac78-b3b943b7c203", "name": "network-vif-deleted", "tag": "9b06e465-3a7f-4846-a56a-a4f169a2010c"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:34:20.121075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:34:20.121075 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:34:20.130819 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc5a5d4-8b68-4dff-b8b1-fb07a3fe95bc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49860. Jan 28 08:34:20.136531 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-11a5b072-14a6-4a08-bef3-32032976d6d0 req-b6cf55d6-41eb-4783-9372-1707efce0493 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:20.136981 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-11a5b072-14a6-4a08-bef3-32032976d6d0 req-b6cf55d6-41eb-4783-9372-1707efce0493 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:20.148105 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-11a5b072-14a6-4a08-bef3-32032976d6d0 req-b6cf55d6-41eb-4783-9372-1707efce0493 service nova] Creating event network-vif-deleted:9b06e465-3a7f-4846-a56a-a4f169a2010c for instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 on hv-cinder-80403 Jan 28 08:34:20.153050 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-11a5b072-14a6-4a08-bef3-32032976d6d0 req-b6cf55d6-41eb-4783-9372-1707efce0493 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038834 Jan 28 08:34:20.153988 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 729/1435] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:34:20.238046 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:20.238650 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:20.245763 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:20.246297 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:20.247561 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:20.248238 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:20.310424 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:20.318358 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-6bc7bb2a-9a6a-4c08-b703-066806ffe205 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 200 len: 1225 microversion: 2.1 time: 0.084368 Jan 28 08:34:20.318928 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 707/1436] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:20 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:21.338392 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:21.339120 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 3f24bdb6-a5a0-4996-ac78-b3b943b7c203] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:21.345629 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:21.346083 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:21.346865 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:21.347338 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:21.360212 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] HTTP exception thrown: Instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 could not be found. Jan 28 08:34:21.360805 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Returning 404 to user: Instance 3f24bdb6-a5a0-4996-ac78-b3b943b7c203 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:34:21.361892 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-2a05a6fa-d7ab-41aa-bcb8-b2c443048199 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203" status: 404 len: 111 microversion: 2.1 time: 0.028882 Jan 28 08:34:21.362933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 730/1437] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:21 2022] GET /compute/v2.1/servers/3f24bdb6-a5a0-4996-ac78-b3b943b7c203 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:34:24.600375 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:24.600902 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:24.602713 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-e1296105-f8d8-45f0-8ada-92052edc15bc req-19f5034b-be56-4850-b293-21fb6ed5928e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20cf233-0ce4-4a7d-bce8-f589df779855", "tag": "1824b52c-794a-4b00-8290-e4a96366bea4"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:34:24.604547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:34:24.604547 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:34:24.607725 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:24.608179 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:24.609438 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:24.610044 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:24.612300 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-e1296105-f8d8-45f0-8ada-92052edc15bc req-19f5034b-be56-4850-b293-21fb6ed5928e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:24.612824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-e1296105-f8d8-45f0-8ada-92052edc15bc req-19f5034b-be56-4850-b293-21fb6ed5928e service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:24.624208 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-e1296105-f8d8-45f0-8ada-92052edc15bc req-19f5034b-be56-4850-b293-21fb6ed5928e service nova] Creating event network-changed:1824b52c-794a-4b00-8290-e4a96366bea4 for instance f20cf233-0ce4-4a7d-bce8-f589df779855 on hv-cinder-80403 Jan 28 08:34:24.629824 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-e1296105-f8d8-45f0-8ada-92052edc15bc req-19f5034b-be56-4850-b293-21fb6ed5928e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 Jan 28 08:34:24.630807 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 731/1438] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:34:24.637891 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Going to try to terminate instance {{(pid=116948) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 08:34:24.890582 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-1ad17933-3e41-4085-8614-c00532a6e962 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 204 len: 0 microversion: 2.1 time: 0.293691 Jan 28 08:34:24.891518 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 708/1439] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:34:24 2022] DELETE /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 08:34:24.899955 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:24.901043 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:24.907669 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:24.908125 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:24.909080 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:24.909522 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:25.045765 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.policy [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116947) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:25.054473 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-40f9ffd1-e744-43ca-9d4f-3c1387a5d3ed tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1577 microversion: 2.1 time: 0.158496 Jan 28 08:34:25.055146 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 732/1440] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:24 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:26.072107 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:26.072806 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:26.079149 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:26.079626 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:26.080396 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:26.080825 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:26.217288 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:26.224759 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-30466d4e-2f47-427c-9127-557b2db9b521 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1459 microversion: 2.1 time: 0.156613 Jan 28 08:34:26.225616 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 709/1441] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:26 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:27.080715 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [req-4d757ac3-e3db-4dc1-872b-48bf6504f69a req-44d13306-8587-4e9e-bd8c-1c8af2d97472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20cf233-0ce4-4a7d-bce8-f589df779855", "name": "network-vif-deleted", "tag": "1824b52c-794a-4b00-8290-e4a96366bea4"}]} {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 08:34:27.083143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 08:34:27.083143 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: warnings.warn(msg) Jan 28 08:34:27.090736 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4d757ac3-e3db-4dc1-872b-48bf6504f69a req-44d13306-8587-4e9e-bd8c-1c8af2d97472 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:27.091172 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [req-4d757ac3-e3db-4dc1-872b-48bf6504f69a req-44d13306-8587-4e9e-bd8c-1c8af2d97472 service nova] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:27.102724 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.compute.server_external_events [req-4d757ac3-e3db-4dc1-872b-48bf6504f69a req-44d13306-8587-4e9e-bd8c-1c8af2d97472 service nova] Creating event network-vif-deleted:1824b52c-794a-4b00-8290-e4a96366bea4 for instance f20cf233-0ce4-4a7d-bce8-f589df779855 on hv-cinder-80403 Jan 28 08:34:27.107767 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [req-4d757ac3-e3db-4dc1-872b-48bf6504f69a req-44d13306-8587-4e9e-bd8c-1c8af2d97472 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Jan 28 08:34:27.108326 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 733/1442] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jan 28 08:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 08:34:27.242663 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:27.247735 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:27.249340 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:27.249785 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:27.250553 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:27.250987 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:27.311896 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.policy [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5f5eca673d4ee3b25d3347b1cd35ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec5fbf3e95e4324800fc5cfe04b6493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116948) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 08:34:27.319892 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-01235db5-ea91-467c-9dcf-bbc88d0ddfd7 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 200 len: 1225 microversion: 2.1 time: 0.081555 Jan 28 08:34:27.322073 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 710/1443] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:27 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 08:34:28.337305 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:28.338009 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: f20cf233-0ce4-4a7d-bce8-f589df779855] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:28.344592 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.345058 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.345844 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.346287 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.370627 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] HTTP exception thrown: Instance f20cf233-0ce4-4a7d-bce8-f589df779855 could not be found. Jan 28 08:34:28.371226 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Returning 404 to user: Instance f20cf233-0ce4-4a7d-bce8-f589df779855 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:34:28.375888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-e1b45ab3-3fda-476c-b9b3-cf0b9317b9f2 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855" status: 404 len: 111 microversion: 2.1 time: 0.039389 Jan 28 08:34:28.375888 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 734/1444] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:28 2022] GET /compute/v2.1/servers/f20cf233-0ce4-4a7d-bce8-f589df779855 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:34:28.872347 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:28.872912 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.compute.api [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116948) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:28.879138 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.880142 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.880917 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.881357 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG oslo_concurrency.lockutils [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.893964 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.wsgi [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] HTTP exception thrown: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. Jan 28 08:34:28.894546 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Returning 404 to user: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. {{(pid=116948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:34:28.896010 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-46b4c866-d1b2-418c-b35f-0aa67ddc92ae tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 404 len: 111 microversion: 2.1 time: 0.027424 Jan 28 08:34:28.896542 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 711/1445] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jan 28 08:34:28 2022] DELETE /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:34:28.904351 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '>' {{(pid=116947) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:28.905046 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.compute.api [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] [instance: 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61] Fetching instance by UUID {{(pid=116947) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 08:34:28.910829 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.911372 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.912165 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 08:34:28.912603 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG oslo_concurrency.lockutils [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Lock "38a2885c-64c6-4bdb-8906-386a5b1cde09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116947) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 08:34:28.925193 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.wsgi [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] HTTP exception thrown: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. Jan 28 08:34:28.925760 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: DEBUG nova.api.openstack.wsgi [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Returning 404 to user: Instance 5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 could not be found. {{(pid=116947) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 08:34:28.926583 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO nova.api.openstack.requestlog [None req-5131e415-e57d-4ae9-a262-c5e7d626903a tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61" status: 404 len: 111 microversion: 2.1 time: 0.025940 Jan 28 08:34:28.927094 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: [pid: 116947|app: 0|req: 735/1446] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jan 28 08:34:28 2022] GET /compute/v2.1/servers/5fdb13bf-0bcf-46ff-a7b3-3bef78918b61 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 08:34:30.329280 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: DEBUG nova.api.openstack.wsgi [None req-ff18886f-2979-4179-9538-ff1ab45354b5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] Calling method '.version_select at 0x7f347420c790>' {{(pid=116948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 08:34:30.427974 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO nova.api.openstack.requestlog [None req-ff18886f-2979-4179-9538-ff1ab45354b5 tempest-TestVolumeBootPattern-532919417 tempest-TestVolumeBootPattern-532919417-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679594344" status: 202 len: 0 microversion: 2.1 time: 0.102396 Jan 28 08:34:30.428570 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: [pid: 116948|app: 0|req: 712/1447] 10.222.0.42 () {58 vars in 1259 bytes} [Fri Jan 28 08:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679594344 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 08:35:33.948933 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:35:33.949546 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:35:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:36:13.975519 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:36:13.976087 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:37:51.730800 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:37:51.731480 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:38:53.956564 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:38:53.957308 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:39:33.984096 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:39:33.984687 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:39:42.177286 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:39:42.177938 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:39:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:39:51.341625 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:39:51.342209 dv-cinder-804035-28-iscsi devstack@n-api.service[116948]: Fri Jan 28 08:39:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 08:39:57.059554 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 08:39:57.060119 dv-cinder-804035-28-iscsi devstack@n-api.service[116947]: Fri Jan 28 08:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!